00010000:00010000:1.0F:1783138135.348781:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1783138135.675157:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138135.675198:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333170176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783138135.675325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1783138135.675865:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333170176 00000100:00100000:3.0:1783138135.675882:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333170176 00000100:00080000:1.0:1783138135.676123:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783138135.676224:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783138135.676236:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333170176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783138135.676270:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783138135.676337:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333170176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138135.676344:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783138135.676790:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333170176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0F:1783138136.393496:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783138137.217019:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1783138137.217043:0:17192:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff955782981840 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1783138137.217049:0:17192:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9558c1e22100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9557829810c0 00000020:00080000:3.0:1783138137.217053:0:17192:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9558c1e22d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95578108ec00 00010000:00010000:3.0:1783138137.224261:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e97a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138137.224280:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e97a35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138137.224289:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e97a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138137.224295:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa2400 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138137.224300:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e97a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138137.224308:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e97a35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138137.224340:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff955882cc5f00) 00010000:00010000:3.0:1783138137.224344:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138137.224363:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e97a35 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138137.224370:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e97a35 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783138137.227178:0:17251:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1783138137.227307:0:17251:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1783138137.400858:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138137.720728:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783138137.720801:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333170304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138137.720895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138137.721097:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333170304 00000100:00100000:0.0:1783138137.721106:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333170304 00000100:00100000:0.0:1783138137.721163:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783138137.721172:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333170304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783138137.721206:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783138137.721273:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333170304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138137.721282:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783138137.721327:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333170304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138137.725498:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333170560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138137.725961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138137.726017:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138137.726024:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578421b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333170688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138137.726049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.726283:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333170816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138137.726316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.726342:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783138137.726350:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333170432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783138137.726374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.730309:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333170816 00000100:00100000:1.0:1783138137.730324:0:17218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333170816 00000100:00100000:1.0:1783138137.730398:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783138137.730409:0:17218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558898f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333170816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783138137.730452:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138137.730584:0:17218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558898f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333170816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (4266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138137.730591:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783138137.730675:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333170816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138137.730797:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333171328:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.730833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.730851:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557839fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869755333171840:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.730871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.730889:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783138137.730894:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bfbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333170944:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.731067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.731099:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333171456:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.731123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.731151:0:20004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333171328 00000100:00100000:1.0:1783138137.731173:0:20004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333171328 00000100:00100000:1.0:1783138137.731203:0:20004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333171840 00000100:00100000:1.0:1783138137.731206:0:20004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333171840 00000100:00100000:1.0:1783138137.731230:0:20004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333171456 00000100:00100000:1.0:1783138137.731233:0:20004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333171456 00000100:00100000:1.0:1783138137.731247:0:20004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783138137.731254:0:20004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333171328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.731294:0:20004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333171328:12345-0@lo:400:kworker.0 Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138137.731301:0:20004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783138137.731313:0:20004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783138137.731319:0:20004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869755333171840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.731363:0:20004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869755333171840:12345-0@lo:400:kworker.0 Request processed in 44us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138137.731369:0:20004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783138137.731382:0:20004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783138137.731387:0:20004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333171456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.731413:0:20004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333171456:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138137.731419:0:20004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783138137.731458:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333170944 00000100:00100000:1.0:1783138137.731462:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333170944 00000100:00100000:1.0:1783138137.731490:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783138137.731496:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15773131-7634-4f0a-907b-e53392c960ab+24:3647:x1869755333170944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138137.731655:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333170560 00000100:00100000:3.0:1783138137.731661:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333170560 00000100:00100000:3.0:1783138137.731689:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333170688 00000100:00100000:3.0:1783138137.731692:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333170688 00000100:00100000:3.0:1783138137.731704:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333170432 00000100:00100000:3.0:1783138137.731706:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333170432 00000100:00100000:3.0:1783138137.731719:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783138137.731725:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333170560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783138137.731748:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783138137.732736:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333171200:0@lo:400:kworker.0 00000100:00100000:3.0:1783138137.733788:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333170560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2058us (7824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138137.733799:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783138137.733834:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783138137.733845:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333170688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783138137.733874:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783138137.733913:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333170688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (7862us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138137.736045:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783138137.736102:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783138137.736119:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bfbcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333170432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783138137.736161:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783138137.736237:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bfbcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333170432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (9860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138137.736244:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783138137.738062:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15773131-7634-4f0a-907b-e53392c960ab+24:3647:x1869755333170944:12345-0@lo:400:kworker.0 Request processed in 6549us (7123us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138137.738078:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1783138137.738141:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783138137.738147:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783138137.738150:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783138137.738153:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783138137.738204:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bfbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333170944:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.738226:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333171456:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.738239:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333171328:0@lo:400:kworker.0 00010000:00080000:1.0:1783138137.738255:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9557839fdf80 x1869755333171840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138137.738266:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557839fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869755333171840:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.738290:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333170432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783138137.739704:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333171072:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.739785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.739822:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95589e8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869755333171584:0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.739849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138137.739893:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578421b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333170688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783138137.739912:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333170560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783138137.740027:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333171072 00000100:00100000:1.0:1783138137.740034:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333171072 00000100:00100000:1.0:1783138137.740103:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783138137.740113:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333171072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.740166:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333171072:12345-0@lo:400:kworker.0 Request processed in 54us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138137.740187:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783138137.740265:0:20004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333171584 00000100:00100000:1.0:1783138137.740269:0:20004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333171584 00000100:00100000:1.0:1783138137.740296:0:20004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783138137.740302:0:20004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869755333171584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138137.740335:0:20004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869755333171584:12345-0@lo:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138137.740340:0:20004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1783138137.740354:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783138137.740358:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138137.740380:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333171072:0@lo:400:kworker.0 00010000:00080000:1.0:1783138137.740390:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95589e8ad880 x1869755333171584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138137.740399:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95589e8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869755333171584:0@lo:400:kworker.0 00000100:00100000:0.0:1783138137.741120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138137.741152:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95589e8af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869755333171712:0@lo:400:kworker.0 00000100:00100000:0.0:1783138137.741177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138137.741210:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333171200 00000100:00100000:0.0:1783138137.741224:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333171200 00000100:00100000:0.0:1783138137.741254:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333171712 00000100:00100000:0.0:1783138137.741257:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333171712 00000100:00100000:0.0:1783138137.741283:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783138137.741289:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333171200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138137.741329:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333171200:12345-0@lo:400:kworker.0 Request processed in 39us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138137.741335:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783138137.741349:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783138137.741355:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869755333171712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138137.741379:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869755333171712:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138137.741384:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1783138137.741401:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138137.741439:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333171200:0@lo:400:kworker.0 00000100:00100000:0.0:1783138137.741449:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95589e8af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869755333171712:0@lo:400:kworker.0 00000100:00100000:2.0:1783138138.338026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138138.338409:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311075584 00000100:00100000:0.0:1783138138.338421:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311075584 00000100:00100000:0.0:1783138138.338499:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:0.0:1783138138.338510:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58205f1d-e75f-42c6-9ee9-e83bde02d19a+13:15604:x1869755311075584:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783138138.338622:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58205f1d-e75f-42c6-9ee9-e83bde02d19a+13:15604:x1869755311075584:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 Request processed in 113us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138138.338646:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00080000:2.0:1783138138.339507:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783138138.341018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138138.346784:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311075712 00000100:00100000:1.0:1783138138.346806:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311075712 00000100:00100000:1.0:1783138138.346906:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:1.0:1783138138.346919:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:15604:x1869755311075712:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1783138138.347063:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783138138.347071:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:15604:x1869755311075712:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 Request processed in 153us (6062us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138138.347081:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:3.0:1783138138.352939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138138.353087:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311075968 00000100:00100000:1.0:1783138138.353101:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311075968 00000100:00100000:1.0:1783138138.353164:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:1.0:1783138138.353174:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58205f1d-e75f-42c6-9ee9-e83bde02d19a+13:15604:x1869755311075968:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783138138.353450:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58205f1d-e75f-42c6-9ee9-e83bde02d19a+14:15604:x1869755311075968:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 276us (520us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1783138138.353457:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00010000:00010000:1.0:1783138138.421768:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783138138.747755:0:17965:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783138139.368353:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138139.368399:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138139.368688:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311076352 00000100:00100000:1.0:1783138139.368701:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311076352 00000100:00100000:1.0:1783138139.368770:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:1.0:1783138139.368782:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2409:x1869755311076352:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783138139.369068:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2409:x1869755311076352:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 287us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138139.369076:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:0.0:1783138139.369215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138139.371070:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311076224 00000100:00100000:1.0:1783138139.371085:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311076224 00000100:00100000:1.0:1783138139.371163:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:1.0:1783138139.371176:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58205f1d-e75f-42c6-9ee9-e83bde02d19a+14:2409:x1869755311076224:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138139.371587:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311076096 00000100:00100000:0.0:1783138139.371594:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311076096 00000100:00100000:0.0:1783138139.371659:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:0.0:1783138139.371677:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+13:2409:x1869755311076096:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783138139.371748:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58205f1d-e75f-42c6-9ee9-e83bde02d19a+14:2409:x1869755311076224:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 575us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138139.371758:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:0.0:1783138139.382229:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+13:2409:x1869755311076096:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 10549us (13873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138139.382245:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:1.0:1783138139.382510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138139.382569:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138139.382653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138139.382964:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311076480 00000100:00100000:0.0:1783138139.382975:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311076480 00000100:00100000:0.0:1783138139.383041:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311076608 00000100:00100000:0.0:1783138139.383045:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311076608 00000100:00100000:0.0:1783138139.383068:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:0.0:1783138139.383075:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2409:x1869755311076608:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138139.383202:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:3.0:1783138139.383212:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2408:x1869755311076480:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:3.0:1783138139.383233:0:18719:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97764 00000100:00080000:3.0:1783138139.383248:0:18719:0:(import.c:65:import_set_state_nolock()) ffff9558b17fd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783138139.383297:0:18719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1783138139.385273:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2409:x1869755311076608:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 2185us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138139.385289:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:0.0:1783138139.385366:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311076736 00000100:00100000:0.0:1783138139.385375:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311076736 00000100:00100000:0.0:1783138139.385423:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00010000:00010000:2.0:1783138139.387127:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783138139.387139:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783138139.387146:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783138139.387149:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138139.388622:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de261139-79c4-4ea6-bf80-66da3b306ba0+6:2409:x1869755311076736:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138139.388760:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de261139-79c4-4ea6-bf80-66da3b306ba0+6:2409:x1869755311076736:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 3328us (6105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138139.388771:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:3.0:1783138139.391898:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58205f1d-e75f-42c6-9ee9-e83bde02d19a+2:2408:x1869755311076480:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 8674us (9374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138139.391914:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:1.0:1783138139.400316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138139.400360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138139.400413:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138139.400519:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311076992 00000100:00100000:3.0:1783138139.400531:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311076992 00000100:00100000:3.0:1783138139.400606:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311077120 00000100:00100000:3.0:1783138139.400610:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311077120 00000100:00100000:3.0:1783138139.400660:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1783138139.400680:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589e8ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2408:x1869755311076992:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:3.0:1783138139.400719:0:18717:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e977a3 00000100:00080000:3.0:1783138139.400728:0:18717:0:(import.c:65:import_set_state_nolock()) ffff955783439800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783138139.400773:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783138139.401375:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589e8ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:de261139-79c4-4ea6-bf80-66da3b306ba0+2:2408:x1869755311076992:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 695us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138139.401398:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1783138139.401418:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:3.0:1783138139.401426:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2408:x1869755311077120:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:3.0:1783138139.401442:0:18717:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e977aa 00000100:00080000:3.0:1783138139.401510:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9558bfa9d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783138139.401542:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1783138139.401767:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:de261139-79c4-4ea6-bf80-66da3b306ba0+2:2408:x1869755311077120:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 240us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138139.401774:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00010000:00010000:3.0:1783138139.401802:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138139.401808:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138139.402445:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783138139.402451:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138139.403295:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311076864 00000100:00100000:0.0:1783138139.403308:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311076864 00000100:00100000:0.0:1783138139.403380:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:0.0:1783138139.403400:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589e8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2409:x1869755311076864:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138139.403479:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589e8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2409:x1869755311076864:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 81us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138139.403499:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00080000:1.0:1783138139.404137:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783138139.450375:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138140.469322:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138140.791845:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783138140.791871:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333171968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138140.791950:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138140.792057:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333171968 00000100:00100000:2.0:1783138140.792066:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333171968 00000100:00100000:2.0:1783138140.792142:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783138140.792153:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333171968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783138140.792190:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783138140.792241:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333171968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138140.792248:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783138140.792299:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333171968:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783138140.792380:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1783138141.366735:0:17246:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783138141.366746:0:17246:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783138141.366770:0:17246:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783138141.366784:0:17246:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1783138141.493051:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138142.525332:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138142.848914:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333172096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138142.849005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138142.849085:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333172096 00000100:00100000:2.0:1783138142.849094:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333172096 00000100:00100000:2.0:1783138142.849146:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783138142.849156:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333172096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783138142.849192:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1783138142.849245:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333172096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138142.849259:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783138142.849546:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333172096:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1783138142.849592:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1783138142.849600:0:17192:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1783138142.849696:0:17251:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1783138142.849706:0:17251:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:0.0:1783138142.852552:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333172352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138142.852647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138142.852730:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333172352 00000100:00100000:0.0:1783138142.852739:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333172352 00000100:00100000:0.0:1783138142.852799:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783138142.852810:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333172352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783138142.852842:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783138142.852889:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333172352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.852896:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1783138142.852918:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783138142.852935:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333172224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138142.852976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138142.853013:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333172224 00000100:00100000:0.0:1783138142.853017:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333172224 00000100:00100000:0.0:1783138142.853044:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783138142.853051:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333172224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783138142.853077:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783138142.853114:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333172224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.853121:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783138142.853180:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333172224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138142.853232:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333172352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138142.854942:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15773131-7634-4f0a-907b-e53392c960ab:3645:1869755333172608:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138142.855059:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333173120:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138142.855114:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869755333173632:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138142.855168:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783138142.855174:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333172736:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138142.855212:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333173248:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138142.855246:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869755333173760:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138142.855294:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333172608 00000100:00100000:2.0:1783138142.855302:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333172608 00000100:00100000:2.0:1783138142.855347:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783138142.855356:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15773131-7634-4f0a-907b-e53392c960ab+24:3645:x1869755333172608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855408:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15773131-7634-4f0a-907b-e53392c960ab+24:3645:x1869755333172608:12345-0@lo:400:kworker.0 Request processed in 52us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138142.855415:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783138142.855490:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333173632 00000100:00100000:2.0:1783138142.855494:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333173632 00000100:00100000:2.0:1783138142.855523:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333173248 00000100:00100000:2.0:1783138142.855526:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333173248 00000100:00100000:2.0:1783138142.855541:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333173760 00000100:00100000:2.0:1783138142.855544:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333173760 00000100:00100000:2.0:1783138142.855560:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783138142.855566:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869755333173632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855600:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869755333173632:12345-0@lo:400:kworker.0 Request processed in 34us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138142.855607:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783138142.855619:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783138142.855626:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333173248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855687:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333173248:12345-0@lo:400:kworker.0 Request processed in 62us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138142.855694:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783138142.855707:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783138142.855713:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869755333173760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855738:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869755333173760:12345-0@lo:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138142.855744:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783138142.855786:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333173248:0@lo:400:kworker.0 00010000:00080000:2.0:1783138142.855800:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95578411b800 x1869755333173760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138142.855811:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869755333173760:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855821:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15773131-7634-4f0a-907b-e53392c960ab:3645:1869755333172608:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.855839:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869755333173632:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.856585:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138142.856656:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138142.856681:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333172992:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.856704:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138142.856722:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869755333173504:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.856745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138142.856769:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783138142.856776:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869755333172864:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.856798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138142.856815:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869755333173376:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.856836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138142.856860:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333173504 00000100:00100000:0.0:1783138142.856866:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333173504 00000100:00100000:0.0:1783138142.856896:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333172864 00000100:00100000:0.0:1783138142.856898:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333172864 00000100:00100000:0.0:1783138142.856908:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333173376 00000100:00100000:0.0:1783138142.856911:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333173376 00000100:00100000:0.0:1783138142.856926:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783138142.856932:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869755333173504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.856989:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869755333173504:12345-0@lo:400:kworker.0 Request processed in 56us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.856997:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783138142.857014:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783138142.857020:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869755333172864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.857066:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869755333172864:12345-0@lo:400:kworker.0 Request processed in 46us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.857073:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783138142.857085:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783138142.857092:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869755333173376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.857117:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869755333173376:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.857123:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1783138142.857141:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783138142.857145:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138142.857159:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333173120 00000100:00100000:0.0:1783138142.857162:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333173120 00000100:00100000:0.0:1783138142.857191:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333172736 00000100:00100000:0.0:1783138142.857195:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333172736 00000100:00100000:0.0:1783138142.857209:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333172992 00000100:00100000:0.0:1783138142.857211:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333172992 00000100:00100000:0.0:1783138142.857223:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783138142.857230:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333173120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.857267:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333173120:12345-0@lo:400:kworker.0 Request processed in 37us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.857274:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783138142.857285:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783138142.857291:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333172736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.857316:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333172736:12345-0@lo:400:kworker.0 Request processed in 26us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.857322:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783138142.857332:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783138142.857345:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333172992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.857395:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333172992:12345-0@lo:400:kworker.0 Request processed in 50us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.857402:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1783138142.857423:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783138142.857427:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783138142.862590:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333172480 00000100:00100000:0.0:1783138142.862604:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333172480 00000100:00100000:0.0:1783138142.862697:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783138142.862708:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333172480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138142.862753:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138142.862841:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333172480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (6185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138142.862849:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783138142.862910:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869755333172864:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.862924:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869755333173376:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.862940:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138142.862950:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333172992:0@lo:400:kworker.0 00010000:00080000:0.0:1783138142.862976:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff955784119c00 x1869755333173504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138142.862987:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869755333173504:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.863032:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333172736:0@lo:400:kworker.0 00000100:00100000:0.0:1783138142.863045:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333173120:0@lo:400:kworker.0 00000100:00100000:2.0:1783138142.863618:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333173888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138142.863691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138142.863904:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333173888 00000100:00100000:3.0:1783138142.863911:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333173888 00000100:00100000:3.0:1783138142.863955:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783138142.863974:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333173888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783138142.863991:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783138142.864043:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333173888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138142.864050:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783138142.864152:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333173888:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1783138142.994098:0:20587:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 00:09:01 (1783138141) 00010000:00010000:3.0:1783138143.542590:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138144.483188:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138144.483234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138144.483266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138144.483293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138144.483312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138144.483335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138144.483407:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311077632 00000100:00100000:3.0:1783138144.483420:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311077632 00000100:00100000:0.0:1783138144.483470:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311077376 00000100:00100000:0.0:1783138144.483476:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311077376 00000100:00100000:3.0:1783138144.483508:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1783138144.483515:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311077888 00000100:00100000:0.0:1783138144.483518:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311077888 00000100:00100000:3.0:1783138144.483519:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2410:x1869755311077632:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138144.483532:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311077504 00000100:00100000:0.0:1783138144.483534:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311077504 00000100:00100000:0.0:1783138144.483545:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311077760 00000100:00100000:0.0:1783138144.483548:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311077760 00000100:00100000:0.0:1783138144.483559:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:0.0:1783138144.483565:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+13:2410:x1869755311077376:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:1.0:1783138144.483618:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783138144.483624:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783138144.483626:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783138144.483688:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2410:x1869755311077632:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 81us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138144.483696:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:1.0:1783138144.484706:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:1.0:1783138144.484721:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bfbc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2410:x1869755311077888:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138144.489263:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+13:2410:x1869755311077376:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 5681us (6069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138144.489282:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:0.0:1783138144.489337:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:0.0:1783138144.489352:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b9622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2410:x1869755311077504:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138144.490105:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b9622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2410:x1869755311077504:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 755us (6788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138144.490585:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:0.0:1783138144.490618:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:0.0:1783138144.490651:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b9621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de261139-79c4-4ea6-bf80-66da3b306ba0+6:2410:x1869755311077760:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138144.491612:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b9621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de261139-79c4-4ea6-bf80-66da3b306ba0+6:2410:x1869755311077760:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 980us (8270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138144.491623:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:0.0:1783138144.492551:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311077248 00000100:00100000:0.0:1783138144.492560:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311077248 00000100:00100000:0.0:1783138144.492611:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:0.0:1783138144.492620:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+13:2410:x1869755311077248:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138144.492815:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+13:2410:x1869755311077248:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 193us (9518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138144.492823:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:1.0:1783138144.498554:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bfbc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2410:x1869755311077888:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 13828us (15276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138144.498570:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00010000:00010000:3.0:1783138144.566005:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783138144.891149:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of de261139-79c4-4ea6-bf80-66da3b306ba0 00000020:00000080:1.0:1783138144.891161:0:18713:0:(genops.c:906:class_export_put()) final put ffff9558b17f8800/de261139-79c4-4ea6-bf80-66da3b306ba0 00000001:00100000:1.0:1783138144.891201:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58205f1d-e75f-42c6-9ee9-e83bde02d19a 00000020:00000080:1.0:1783138144.891204:0:18713:0:(genops.c:906:class_export_put()) final put ffff9558b17fb800/58205f1d-e75f-42c6-9ee9-e83bde02d19a 00000020:00000080:1.0:1783138144.891219:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b17f8800/de261139-79c4-4ea6-bf80-66da3b306ba0 for lustre-OST0000 00000020:00000080:1.0:1783138144.891260:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b17fb800/58205f1d-e75f-42c6-9ee9-e83bde02d19a for lustre-OST0000 00000020:00000080:1.0:1783138144.891277:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955783439800 for lustre-OST0000 00000020:00000080:1.0:1783138144.891292:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b17fd800 for lustre-OST0000 00000001:00100000:2.0:1783138144.898252:0:19532:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of de261139-79c4-4ea6-bf80-66da3b306ba0 00000020:00000080:2.0:1783138144.898261:0:19532:0:(genops.c:906:class_export_put()) final put ffff95578343e000/de261139-79c4-4ea6-bf80-66da3b306ba0 00000020:00000080:0.0:1783138144.898335:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff95578343e000/de261139-79c4-4ea6-bf80-66da3b306ba0 for lustre-OST0001 00000020:00000080:0.0:1783138144.898386:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558bfa9d800 for lustre-OST0001 00010000:00010000:1.0:1783138145.590118:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138145.908991:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138145.909017:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333174016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783138145.909094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138145.909197:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333174016 00000100:00100000:3.0:1783138145.909207:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333174016 00000100:00100000:3.0:1783138145.909284:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783138145.909296:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333174016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783138145.909332:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783138145.909386:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333174016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138145.909393:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783138145.909499:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333174016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783138145.909626:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783138146.614010:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138146.893968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138146.902274:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311078144 00000100:00100000:3.0:1783138146.902291:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311078144 00000100:00080000:1.0:1783138146.902399:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783138146.902537:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1783138146.902554:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58205f1d-e75f-42c6-9ee9-e83bde02d19a+13:16364:x1869755311078144:12345-192.168.201.6@tcp:35:umount.0 00000001:00080000:3.0:1783138146.903328:0:17215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1783138146.903498:0:17215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1783138146.904304:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58205f1d-e75f-42c6-9ee9-e83bde02d19a+16:16364:x1869755311078144:12345-192.168.201.6@tcp:35:umount.0 Request processed in 1752us (10343us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1783138146.904315:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000020:00080000:3.0:1783138146.904321:0:17215:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783138146.910790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138146.910840:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138146.910967:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311078400 00000100:00100000:1.0:1783138146.910979:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311078400 00000100:00100000:1.0:1783138146.911043:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311078272 00000100:00100000:1.0:1783138146.911046:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311078272 00000100:00100000:1.0:1783138146.911074:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1783138146.911084:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+14:2410:x1869755311078400:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138146.911100:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138146.911119:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558c21d2e00/0x6bc248e9a4e97748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9673c expref: 14 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.911148:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138146.911213:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+13:2410:x1869755311078400:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 130us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138146.911220:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1783138146.911237:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1783138146.911243:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+12:2410:x1869755311078272:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138146.911251:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138146.911259:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7156e00/0x6bc248e9a4e97741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9670b expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.911267:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138146.911282:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+11:2410:x1869755311078272:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 40us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138146.911289:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1783138146.914838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138146.914950:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311078528 00000100:00100000:2.0:1783138146.914960:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311078528 00000100:00100000:2.0:1783138146.915027:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1783138146.915036:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ba85a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+11:2409:x1869755311078528:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783138146.915054:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138146.915084:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7156000/0x6bc248e9a4e977cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b967f2 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138146.915104:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138146.915171:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ba85a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+10:2409:x1869755311078528:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 135us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138146.915180:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:3.0:1783138146.919296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138146.919518:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311078656 00000100:00100000:2.0:1783138146.919528:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311078656 00000100:00100000:2.0:1783138146.919608:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:2.0:1783138146.919619:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2408:x1869755311078656:12345-192.168.201.6@tcp:9:umount.0 00000020:00000080:2.0:1783138146.919725:0:18717:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9776b 00000100:00080000:2.0:1783138146.919737:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9558b17f9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783138146.919787:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1783138146.919985:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58205f1d-e75f-42c6-9ee9-e83bde02d19a+2:2408:x1869755311078656:12345-192.168.201.6@tcp:9:umount.0 Request processed in 367us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138146.919995:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00010000:00010000:2.0:1783138146.920017:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138146.920669:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783138146.936115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138146.936330:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311079552 00000100:00100000:0.0:1783138146.936343:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311079552 00000100:00100000:0.0:1783138146.936442:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:0.0:1783138146.936453:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+16:2408:x1869755311079552:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:0.0:1783138146.936492:0:19431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9775d 00000020:00010000:0.0:1783138146.936511:0:19431:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9558b1789000: total 0 00000100:00080000:0.0:1783138146.936515:0:19431:0:(import.c:65:import_set_state_nolock()) ffff9558b1788800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783138146.936544:0:19431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1783138146.936745:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58205f1d-e75f-42c6-9ee9-e83bde02d19a+15:2408:x1869755311079552:12345-192.168.201.6@tcp:39:umount.0 Request processed in 293us (639us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1783138146.936754:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00000020:00010000:1.0:1783138146.937503:0:17201:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9558b1789000: total 0 00010000:00010000:1.0:1783138146.937511:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138146.937565:0:17201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9558b1789000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1783138146.937600:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9557828b8e00) 00010000:00010000:1.0:1783138146.937603:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783138146.937612:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043000/0x6bc248e9a4e9797f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96862 expref: 14 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.937675:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff955882cc5f00) 00010000:00010000:1.0:1783138146.937678:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783138146.937682:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302aa00/0x6bc248e9a4e97a0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9688c expref: 13 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.937701:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff955882f5b500) 00010000:00010000:1.0:1783138146.937704:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138146.937708:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e9783d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96800 expref: 12 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.937721:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9557828b8f00) 00010000:00010000:1.0:1783138146.937723:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783138146.937726:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c21d2600/0x6bc248e9a4e9787c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9680e expref: 11 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.937738:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9557828b8e00) 00010000:00010000:1.0:1783138146.937740:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783138146.937743:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2200/0x6bc248e9a4e97a66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968a8 expref: 10 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.937774:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff955882cc5600) 00010000:00010000:1.0:1783138146.937777:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783138146.937780:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302be00/0x6bc248e9a4e97821 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b967f9 expref: 9 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.937794:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff955882cc5e00) 00010000:00010000:1.0:1783138146.937796:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783138146.937799:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e97901 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96838 expref: 8 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.937812:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9557828b8e00) 00010000:00010000:1.0:1783138146.937815:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783138146.937818:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2800/0x6bc248e9a4e979b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96877 expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138146.937828:0:17201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9558b1789000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1783138146.937840:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138146.937842:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138146.937844:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138146.950797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138146.950970:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311079680 00000100:00100000:0.0:1783138146.950982:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311079680 00000100:00100000:0.0:1783138146.951065:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:0.0:1783138146.951076:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58205f1d-e75f-42c6-9ee9-e83bde02d19a+5:2408:x1869755311079680:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:0.0:1783138146.951117:0:17214:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97756 00000100:00080000:0.0:1783138146.951136:0:17214:0:(import.c:65:import_set_state_nolock()) ffff955781f4c000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1783138146.951238:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:0.0:1783138146.951328:0:17214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1783138146.951820:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138146.952057:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58205f1d-e75f-42c6-9ee9-e83bde02d19a+3:2408:x1869755311079680:12345-192.168.201.6@tcp:39:umount.0 Request processed in 979us (1266us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783138146.952076:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00010000:00010000:2.0:1783138147.638046:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138147.957102:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333174400:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957196:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138147.957258:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333174912:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138147.957295:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333175424:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138147.957342:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783138147.957347:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333174528:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138147.957395:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333175040:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138147.957429:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869755333175552:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138147.957478:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333174400 00000100:00100000:2.0:1783138147.957487:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333174400 00000100:00100000:2.0:1783138147.957541:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333174912 00000100:00100000:2.0:1783138147.957545:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333174912 00000100:00100000:2.0:1783138147.957578:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333174528 00000100:00100000:2.0:1783138147.957581:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333174528 00000100:00100000:2.0:1783138147.957592:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333175040 00000100:00100000:2.0:1783138147.957595:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333175040 00000100:00100000:2.0:1783138147.957609:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783138147.957616:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558898f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333174400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957706:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558898f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333174400:12345-0@lo:400:kworker.0 Request processed in 89us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138147.957713:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783138147.957729:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138147.957735:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578411ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333174912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957763:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578411ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333174912:12345-0@lo:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138147.957768:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138147.957778:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783138147.957785:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333174528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957812:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333174528:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138147.957818:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783138147.957827:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783138147.957833:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578411aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333175040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957857:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578411aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333175040:12345-0@lo:400:kworker.0 Request processed in 24us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138147.957862:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1783138147.957890:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783138147.957894:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783138147.957924:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333174528:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957945:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333175040:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957954:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333174400:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.957962:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333174912:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958132:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15773131-7634-4f0a-907b-e53392c960ab:3645:1869755333174144:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138147.958198:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869755333174656:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138147.958242:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333175168:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138147.958288:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869755333175680:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958308:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138147.958330:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783138147.958336:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333174272:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138147.958380:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333174784:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138147.958416:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333175296:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958433:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138147.958453:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333175424 00000100:00100000:1.0:1783138147.958459:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333175424 00000100:00100000:1.0:1783138147.958489:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333175552 00000100:00100000:1.0:1783138147.958492:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333175552 00000100:00100000:1.0:1783138147.958504:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333174656 00000100:00100000:1.0:1783138147.958506:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333174656 00000100:00100000:1.0:1783138147.958517:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333175168 00000100:00100000:1.0:1783138147.958519:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333175168 00000100:00100000:1.0:1783138147.958527:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333175680 00000100:00100000:1.0:1783138147.958530:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333175680 00000100:00100000:1.0:1783138147.958541:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333175296 00000100:00100000:1.0:1783138147.958543:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333175296 00000100:00100000:1.0:1783138147.958555:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783138147.958560:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578411bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333175424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958598:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578411bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333175424:12345-0@lo:400:kworker.0 Request processed in 38us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.958605:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783138147.958618:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783138147.958624:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869755333175552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958699:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869755333175552:12345-0@lo:400:kworker.0 Request processed in 75us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.958706:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783138147.958718:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783138147.958723:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b9621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869755333174656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958760:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b9621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869755333174656:12345-0@lo:400:kworker.0 Request processed in 36us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.958765:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783138147.958776:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783138147.958780:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b72ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333175168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958804:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b72ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333175168:12345-0@lo:400:kworker.0 Request processed in 23us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.958809:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783138147.958818:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783138147.958823:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b72aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869755333175680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958865:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b72aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869755333175680:12345-0@lo:400:kworker.0 Request processed in 43us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.958871:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783138147.958891:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783138147.958896:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333175296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.958924:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333175296:12345-0@lo:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.958929:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783138147.958946:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333174272 00000100:00100000:1.0:1783138147.958951:0:17218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333174272 00000100:00100000:1.0:1783138147.958980:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333174784 00000100:00100000:1.0:1783138147.958984:0:17218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333174784 00000100:00100000:1.0:1783138147.958995:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783138147.959000:0:17218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b72a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333174272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.959032:0:17218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b72a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333174272:12345-0@lo:400:kworker.0 Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.959038:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783138147.959048:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783138147.959053:0:17218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b72aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333174784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.959076:0:17218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b72aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333174784:12345-0@lo:400:kworker.0 Request processed in 24us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.959081:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783138147.959121:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333174272:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.959133:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333174784:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.959143:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333175296:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.959152:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869755333174656:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.959162:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333175168:0@lo:400:kworker.0 00010000:00080000:1.0:1783138147.959174:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9558b7175880 x1869755333175680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138147.959191:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869755333175680:0@lo:400:kworker.0 00000100:00100000:2.0:1783138147.959421:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333174144 00000100:00100000:2.0:1783138147.959426:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333174144 00000100:00080000:3.0:1783138147.959462:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783138147.959468:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783138147.959504:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869755333175552:0@lo:400:kworker.0 00010000:00080000:3.0:1783138147.959521:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9558b7176d80 x1869755333175424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138147.959533:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333175424:0@lo:400:kworker.0 00000100:00100000:1.0:1783138147.959542:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783138147.959557:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95588bcd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333175808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138147.959594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138147.959626:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333175808 00000100:00100000:1.0:1783138147.959650:0:17218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333175808 00000100:00100000:1.0:1783138147.959670:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783138147.959675:0:17218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333175808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783138147.959710:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1783138147.959751:0:17218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333175808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138147.959756:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783138147.959788:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95588bcd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333175808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138147.972745:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783138147.972770:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15773131-7634-4f0a-907b-e53392c960ab+24:3645:x1869755333174144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138147.972841:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333176064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138147.975463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138147.975544:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783138147.975558:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333175936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138147.975600:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138147.975660:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333176064 00000100:00100000:0.0:1783138147.975669:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333176064 00000100:00100000:0.0:1783138147.975711:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333175936 00000100:00100000:0.0:1783138147.975713:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333175936 00000100:00100000:0.0:1783138147.975727:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783138147.975736:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333176064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783138147.975777:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783138147.975819:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333176064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138147.975826:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783138147.975843:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783138147.975849:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333175936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138147.975866:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138147.975903:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333175936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138147.975909:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783138147.975955:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333175936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783138147.975993:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333176320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783138147.975994:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333176064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783138147.976047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138147.976086:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138147.976088:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333176320 00000100:00100000:0.0:1783138147.976092:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333176320 00000100:00100000:3.0:1783138147.976097:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333176192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138147.976116:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783138147.976124:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333176320:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783138147.976130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783138147.976135:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783138147.976173:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333176192 00000100:00100000:0.0:1783138147.976177:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333176320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138147.976179:0:17218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333176192 00000100:00100000:0.0:1783138147.976186:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783138147.976217:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783138147.976218:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333176320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783138147.976229:0:17218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333176192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783138147.976256:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783138147.976364:0:17218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333176192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138147.976370:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783138147.976556:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333176192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138147.978433:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15773131-7634-4f0a-907b-e53392c960ab+24:3645:x1869755333174144:12345-0@lo:400:kworker.0 Request processed in 5665us (20253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138147.978449:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783138147.978698:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15773131-7634-4f0a-907b-e53392c960ab:3645:1869755333174144:0@lo:400:kworker.0 00010000:00010000:1.0:1783138148.661001:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783138148.984042:0:17965:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783138149.568740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138149.568801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138149.568840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138149.568883:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311079936 00000100:00100000:1.0:1783138149.568898:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311079936 00000100:00100000:1.0:1783138149.568951:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311079808 00000100:00100000:1.0:1783138149.568954:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311079808 00000100:00100000:1.0:1783138149.568963:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311080064 00000100:00100000:1.0:1783138149.568965:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311080064 00000100:00100000:1.0:1783138149.568981:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1783138149.568988:0:17198:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783138149.568991:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+12:2409:x1869755311079936:12345-192.168.201.6@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783138149.569002:0:17198:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1783138149.569011:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138149.569034:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558c21d2200/0x6bc248e9a4e97787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b967ac expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138149.569059:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138149.569151:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+11:2409:x1869755311079936:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 161us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138149.569158:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1783138149.569190:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783138149.569195:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+10:2409:x1869755311079808:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138149.569203:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138149.569211:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558c21d3000/0x6bc248e9a4e97780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9677b expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138149.569222:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138149.569238:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+9:2409:x1869755311079808:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 43us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138149.569244:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783138149.569253:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1783138149.569268:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+8:2409:x1869755311080064:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138149.569275:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138149.569285:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558c2043e00/0x6bc248e9a4e977c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b967eb expref: 8 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138149.569294:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138149.569309:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe00a1a-4447-4726-80bb-e00441fd4ed9+7:2409:x1869755311080064:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 51us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138149.569315:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1783138149.601434:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138149.601674:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311080320 00000100:00100000:1.0:1783138149.601686:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311080320 00000100:00100000:1.0:1783138149.601784:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:1.0:1783138149.601796:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de261139-79c4-4ea6-bf80-66da3b306ba0+6:2408:x1869755311080320:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:1.0:1783138149.601840:0:17213:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97795 00000020:00010000:1.0:1783138149.601875:0:17213:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9558c1e1d800: total 0 00000100:00080000:1.0:1783138149.601881:0:17213:0:(import.c:65:import_set_state_nolock()) ffff9558c1e1c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783138149.601936:0:17213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:0.0:1783138149.601979:0:19434:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9558c1e1d800: total 0 00010000:00010000:0.0:1783138149.602047:0:19434:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9558c1e1d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783138149.602085:0:19434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9557828b8f00) 00010000:00010000:0.0:1783138149.602090:0:19434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783138149.602099:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2c00/0x6bc248e9a4e9788a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96815 expref: 5 pid: 20004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138149.602120:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de261139-79c4-4ea6-bf80-66da3b306ba0+4:2408:x1869755311080320:12345-192.168.201.6@tcp:39:umount.0 Request processed in 324us (696us total) trans 8589934628 rc 0/0 00010000:00010000:0.0:1783138149.602124:0:19434:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9558c1e1d800, canceled 1 locks, left on hash table 0. 00000100:00100000:1.0:1783138149.602130:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00010000:00010000:0.0:1783138149.602140:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138149.602143:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138149.602145:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783138149.602881:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138149.603039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138149.603111:0:20004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311080448 00000100:00100000:2.0:1783138149.603118:0:20004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311080448 00000100:00100000:2.0:1783138149.604288:0:20004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:2.0:1783138149.604304:0:20004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2410:x1869755311080448:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783138149.604383:0:20004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2410:x1869755311080448:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 85us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138149.604388:0:20004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00080000:3.0:1783138149.609788:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783138149.620417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138149.620559:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311080576 00000100:00100000:2.0:1783138149.620570:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311080576 00000100:00100000:2.0:1783138149.620669:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:2.0:1783138149.620680:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de261139-79c4-4ea6-bf80-66da3b306ba0+5:2408:x1869755311080576:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:2.0:1783138149.620726:0:17214:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9779c 00000100:00080000:2.0:1783138149.620744:0:17214:0:(import.c:65:import_set_state_nolock()) ffff9558c1e1d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783138149.620776:0:17214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1783138149.620973:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de261139-79c4-4ea6-bf80-66da3b306ba0+3:2408:x1869755311080576:12345-192.168.201.6@tcp:39:umount.0 Request processed in 294us (566us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783138149.620991:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00010000:00010000:3.0:1783138149.621281:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138149.685710:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138149.688275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138149.688381:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311080832 00000100:00100000:2.0:1783138149.688392:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311080832 00000100:00100000:2.0:1783138149.688472:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:2.0:1783138149.688482:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fe00a1a-4447-4726-80bb-e00441fd4ed9+7:2408:x1869755311080832:12345-192.168.201.6@tcp:251:umount.0 00000020:00000080:2.0:1783138149.688546:0:17207:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97733 00000020:00010000:2.0:1783138149.688553:0:17207:0:(genops.c:1942:obd_stale_export_put()) Put export ffff955782aa4800: total 0 00000100:00080000:2.0:1783138149.688558:0:17207:0:(import.c:65:import_set_state_nolock()) ffff955782aa1800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783138149.688680:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fe00a1a-4447-4726-80bb-e00441fd4ed9+3:2408:x1869755311080832:12345-192.168.201.6@tcp:251:umount.0 Request processed in 199us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138149.688689:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 173 00000020:00010000:3.0:1783138149.689041:0:19434:0:(genops.c:1928:obd_stale_export_get()) Get export ffff955782aa4800: total 0 00010000:00010000:3.0:1783138149.689172:0:19434:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff955782aa4800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783138149.689208:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558c21d3e00/0x6bc248e9a4e9773a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96704 expref: 2 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138149.689232:0:19434:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff955782aa4800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1783138149.689244:0:19434:0:(genops.c:906:class_export_put()) final put ffff955782aa4800/9fe00a1a-4447-4726-80bb-e00441fd4ed9 00010000:00010000:3.0:1783138149.689303:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138149.689306:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138149.689308:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783138149.698760:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955782aa4800/9fe00a1a-4447-4726-80bb-e00441fd4ed9 for MGS 00000020:00000080:0.0:1783138149.698831:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955782aa1800 for MGS 00010000:00010000:1.0:1783138150.710472:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138151.028909:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333176448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138151.028996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138151.029053:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333176448 00000100:00100000:0.0:1783138151.029062:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333176448 00000100:00100000:0.0:1783138151.029142:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783138151.029153:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333176448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783138151.029188:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138151.029247:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333176448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138151.029255:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783138151.029297:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333176448:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783138151.029399:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1783138151.605573:0:17246:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783138151.605584:0:17246:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783138151.605608:0:17246:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783138151.605616:0:17246:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:01000004:0.0:1783138151.611037:0:20784:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783138151.616793:0:20784:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783138151.616858:0:20784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.616872:0:20784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.616880:0:20784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.616887:0:20784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.616914:0:20784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783138151.616920:0:20784:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783138151.616947:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783138151.616952:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783138151.616958:0:20784:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783138151.616994:0:20784:0:(import.c:65:import_set_state_nolock()) ffff955889ec3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783138151.617028:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869755333176576:0@lo:39:umount.0 00000100:00100000:0.0:1783138151.617099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783138151.617232:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138151.617240:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138151.617248:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7024c00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138151.617251:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138151.617258:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138151.617264:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138151.617267:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783138151.617269:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783138151.617270:0:17201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783138151.617298:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138151.617315:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138151.617446:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138151.617453:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7024c00/0x6bc248e9a4e972f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e972fd expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138151.617461:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138151.617462:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138151.617464:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138151.617476:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333176576 00000100:00100000:1.0:1783138151.617481:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333176576 00000100:00100000:1.0:1783138151.617518:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783138151.617524:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1869755333176576:12345-0@lo:39:umount.0 00000100:00100000:3.0:1783138151.617598:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783138151.617606:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333176704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138151.617655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1783138151.617724:0:17213:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97327 00000100:00080000:1.0:1783138151.617731:0:17213:0:(import.c:65:import_set_state_nolock()) ffff955783461800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783138151.617766:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138151.617794:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1869755333176576:12345-0@lo:39:umount.0 Request processed in 269us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138151.617803:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1783138151.617822:0:17213:0:(genops.c:906:class_export_put()) final put ffff955783462000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1783138151.617824:0:3644:0:(import.c:65:import_set_state_nolock()) ffff955889ec3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783138151.617832:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869755333176576:0@lo:39:umount.0 00000020:00000080:1.0:1783138151.617850:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955783462000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783138151.617896:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955783461800 for lustre-MDT0000 00000100:00080000:0.0:1783138151.617952:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783138151.617954:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783138151.617957:0:20784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1783138151.618938:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333176704 00000100:00100000:3.0:1783138151.618950:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333176704 00000100:00100000:3.0:1783138151.619018:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783138151.619028:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15773131-7634-4f0a-907b-e53392c960ab+24:3647:x1869755333176704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783138151.619046:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138151.619065:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff955880030a00/0x6bc248e9a4e972fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e972f6 expref: 24 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.619084:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138151.619164:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15773131-7634-4f0a-907b-e53392c960ab+23:3647:x1869755333176704:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138151.619183:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783138151.619227:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333176704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138151.621078:0:20784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621094:0:20784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621102:0:20784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621109:0:20784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621134:0:20784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138151.621141:0:20784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621149:0:20784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621155:0:20784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621162:0:20784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621187:0:20784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783138151.621194:0:20784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621201:0:20784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.621205:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138151.621209:0:20784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.621216:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621218:0:20784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621244:0:20784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783138151.621249:0:20784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.621251:0:19434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138151.621257:0:19434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621257:0:20784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621264:0:20784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.621265:0:19434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c21d3800 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:3.0:1783138151.621269:0:19434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621271:0:20784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138151.621277:0:20784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783138151.621280:0:20784:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1783138151.621289:0:19434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138151.621295:0:19434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138151.621300:0:19434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:01000004:0.0:1783138151.621316:0:20784:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783138151.621320:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783138151.621324:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138151.621329:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1783138151.621336:0:20784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9558b178f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783138151.621342:0:20784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff95578343b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783138151.621346:0:20784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff955783aea800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783138151.621351:0:20784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9558bfae6800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783138151.621359:0:20784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9558c1e1d800 de261139-79c4-4ea6-bf80-66da3b306ba0 192.168.201.6@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1783138151.621364:0:20784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9558b1789000 58205f1d-e75f-42c6-9ee9-e83bde02d19a 192.168.201.6@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1783138151.621370:0:20784:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9558b1838000) has exports, disconnecting them 00000020:00080000:0.0:1783138151.621374:0:20784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9558b178f000), last request at 1783138147 00000020:00000080:0.0:1783138151.621385:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97622 00010000:00010000:2.0:1783138151.621387:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7156c00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138151.621392:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.621402:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783138151.621410:0:20784:0:(import.c:65:import_set_state_nolock()) ffff9558b178e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783138151.621459:0:20784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9558b178f000): rc 0 00000020:00000080:0.0:1783138151.621462:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b178f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783138151.621471:0:20784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95578343b800), last request at 1783138147 00000020:00000080:0.0:1783138151.621473:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e974c4 00000100:00080000:0.0:1783138151.621478:0:20784:0:(import.c:65:import_set_state_nolock()) ffff95578343f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783138151.621484:0:20784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff95578343b800): rc 0 00000020:00000080:0.0:1783138151.621488:0:20784:0:(genops.c:906:class_export_put()) final put ffff95578343b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783138151.621494:0:20784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff955783aea800), last request at 1783138076 10000000:00010000:2.0:1783138151.621498:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783138151.621499:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97415 00000100:00080000:0.0:1783138151.621504:0:20784:0:(import.c:65:import_set_state_nolock()) ffff9558b5d3f000 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1783138151.621510:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:0.0:1783138151.621512:0:20784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff955783aea800): rc 0 10000000:01000000:2.0:1783138151.621514:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:00000080:0.0:1783138151.621516:0:20784:0:(genops.c:906:class_export_put()) final put ffff955783aea800/lustre-MDT0000-lwp-MDT0001_UUID 10000000:01000000:2.0:1783138151.621519:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:0.0:1783138151.621529:0:20784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9558bfae6800), last request at 1783138076 00000020:00000080:0.0:1783138151.621532:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e973ba 00000100:00080000:0.0:1783138151.621536:0:20784:0:(import.c:65:import_set_state_nolock()) ffff9558bfae3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783138151.621543:0:20784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:2.0:1783138151.621561:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.621569:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138151.621594:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.621602:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7156c00/0x6bc248e9a4e97247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9724e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.621616:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138151.621620:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783138151.621624:0:20784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9558bfae6800): rc 0 00000004:00000080:0.0:1783138151.621661:0:20784:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb79741a33ae0 00000100:00080000:0.0:1783138151.621682:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783138151.621687:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 10000000:01000000:3.0:1783138151.621840:0:19434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783138151.621843:0:19434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783138151.621922:0:19434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.621929:0:19434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138151.621936:0:19434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.621943:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558c21d3800/0x6bc248e9a4e97653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9765a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.621968:0:19434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138151.621971:0:19434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.621977:0:19434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7157a00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:3.0:1783138151.621980:0:19434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.621987:0:19434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138151.621993:0:19434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138151.621999:0:19434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783138151.622001:0:19434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783138151.622003:0:19434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783138151.622013:0:19434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.622019:0:19434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138151.622034:0:19434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.622041:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7157a00/0x6bc248e9a4e97239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97240 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.622050:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138151.622051:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138151.622058:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138151.622067:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783138151.622085:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15773131-7634-4f0a-907b-e53392c960ab:3648:1869755333177088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138151.622208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138151.622267:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333177088 00000100:00100000:3.0:1783138151.622418:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333177088 00000100:00100000:3.0:1783138151.622462:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138151.622470:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15773131-7634-4f0a-907b-e53392c960ab+23:3648:x1869755333177088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783138151.622483:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138151.622495:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834dfe00/0x6bc248e9a4e97240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e97239 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138151.622507:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1783138151.622528:0:20784:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783138151.622541:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15773131-7634-4f0a-907b-e53392c960ab+22:3648:x1869755333177088:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (333us total) trans 0 rc 0/0 00000100:00080000:0.0:1783138151.622541:0:20784:0:(import.c:65:import_set_state_nolock()) ffff9558b1cfe000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783138151.622547:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138151.622585:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15773131-7634-4f0a-907b-e53392c960ab:3648:1869755333177088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138151.622608:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333177216:0@lo:39:umount.0 00000100:00100000:3.0:1783138151.622661:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138151.622671:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15773131-7634-4f0a-907b-e53392c960ab:3645:1869755333176832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138151.622703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138151.622740:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783138151.622748:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15773131-7634-4f0a-907b-e53392c960ab:3645:1869755333176960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138151.622751:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7157200 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138151.622757:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.622766:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138151.622773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1783138151.622780:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138151.622796:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1783138151.622796:0:20697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333176832 10000000:01000000:2.0:1783138151.622800:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000100:00100000:1.0:1783138151.622802:0:20697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333176832 10000000:01000000:2.0:1783138151.622803:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783138151.622836:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.622843:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783138151.622845:0:20697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333176960 00000100:00100000:1.0:1783138151.622855:0:20697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333176960 00010000:00010000:2.0:1783138151.622860:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138151.622868:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7157200/0x6bc248e9a4e977fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97805 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138151.622879:0:20697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1783138151.622880:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138151.622884:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138151.622887:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138151.622888:0:20697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15773131-7634-4f0a-907b-e53392c960ab+23:3645:x1869755333176832:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138151.622898:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1783138151.622898:0:20697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138151.622908:0:20697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834df000/0x6bc248e9a4e9724e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e97247 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138151.622913:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333177344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138151.622922:0:20697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138151.622959:0:20697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15773131-7634-4f0a-907b-e53392c960ab+22:3645:x1869755333176832:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138151.622961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138151.622970:0:20697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783138151.622985:0:20697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333177344 00000100:00100000:1.0:1783138151.622988:0:20697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333177344 00000100:00100000:1.0:1783138151.623003:0:20697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783138151.623009:0:20697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15773131-7634-4f0a-907b-e53392c960ab+22:3645:x1869755333176960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138151.623016:0:20697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138151.623023:0:20697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7157c00/0x6bc248e9a4e9765a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e97653 expref: 22 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138151.623030:0:20697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138151.623050:0:20697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15773131-7634-4f0a-907b-e53392c960ab+21:3645:x1869755333176960:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138151.623056:0:20697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783138151.623094:0:20697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138151.623099:0:20697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578411a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15773131-7634-4f0a-907b-e53392c960ab+20:3647:x1869755333177344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138151.623106:0:20697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138151.623113:0:20697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558c2042400/0x6bc248e9a4e97805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e977fe expref: 20 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138151.623133:0:20697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138151.623157:0:20697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578411a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15773131-7634-4f0a-907b-e53392c960ab+19:3647:x1869755333177344:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138151.623163:0:20697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000080:1.0:1783138151.623262:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b178f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783138151.623304:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff95578343b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783138151.623327:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955783aea800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783138151.623349:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b178e000 for lustre-MDT0000 00000020:00000080:1.0:1783138151.623354:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff95578343f000 for lustre-MDT0000 00000020:00000080:1.0:1783138151.623357:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b5d3f000 for lustre-MDT0000 00000100:00100000:1.0:1783138151.623382:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15773131-7634-4f0a-907b-e53392c960ab:3645:1869755333176960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138151.623390:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15773131-7634-4f0a-907b-e53392c960ab:3645:1869755333176832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138151.623407:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138151.624605:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333177344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138151.627459:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333177216 00000100:00100000:0.0:1783138151.627478:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333177216 00000100:00100000:0.0:1783138151.627558:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783138151.627568:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1869755333177216:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783138151.627609:0:17952:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9743f 00000100:00080000:0.0:1783138151.627619:0:17952:0:(import.c:65:import_set_state_nolock()) ffff9558bfa83800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783138151.627665:0:17952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1783138151.627873:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3644:x1869755333177216:12345-0@lo:39:umount.0 Request processed in 306us (5211us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783138151.627881:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1783138151.627965:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783138151.627969:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1783138151.627981:0:20784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783138151.628047:0:20784:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783138151.628071:0:20784:0:(import.c:65:import_set_state_nolock()) ffff9558bfb19000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783138151.628083:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783138151.628085:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1783138151.628093:0:20784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783138151.628180:0:20784:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783138151.628190:0:20784:0:(import.c:65:import_set_state_nolock()) ffff9558b1cef000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783138151.628236:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9558b1838000) has no exports 00010000:00010000:3.0:1783138151.629158:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138151.629183:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333177472:0@lo:9:umount.0 00000100:00100000:3.0:1783138151.629244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138151.629272:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333177600:0@lo:9:umount.0 00000100:00100000:3.0:1783138151.629515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783138151.629562:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1cfe000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783138151.629569:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333177216:0@lo:39:umount.0 00000100:00100000:3.0:1783138151.629613:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333177472 00000100:00100000:3.0:1783138151.629620:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333177472 00000100:00100000:3.0:1783138151.629675:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333177600 00000100:00100000:3.0:1783138151.629678:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333177600 00000100:00100000:3.0:1783138151.629709:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783138151.629718:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1869755333177472:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783138151.629746:0:18717:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9750a 00000100:00080000:3.0:1783138151.629755:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9558b1cee000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783138151.629795:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783138151.630009:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3644:x1869755333177472:12345-0@lo:9:umount.0 Request processed in 292us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138151.630016:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783138151.630030:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783138151.630036:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1869755333177600:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783138151.630048:0:18717:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97661 00000100:00080000:3.0:1783138151.630054:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9558b17ff000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783138151.630082:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:0.0:1783138151.630105:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558bfb19000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783138151.630116:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783138151.630118:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783138151.630121:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333177472:0@lo:9:umount.0 00000100:00100000:3.0:1783138151.630220:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3644:x1869755333177600:12345-0@lo:9:umount.0 Request processed in 184us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138151.630227:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1783138151.630249:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783138151.630257:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783138151.630648:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1cef000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783138151.630662:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783138151.630664:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783138151.630668:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333177600:0@lo:9:umount.0 00010000:00010000:1.0:1783138151.630755:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783138151.638967:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9558b1838000) has no exports 00000020:00000080:0.0:1783138151.697502:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97294 00000020:00000080:0.0:1783138151.697520:0:20784:0:(genops.c:906:class_export_put()) final put ffff955784230800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783138151.697585:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783138151.697789:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138151.697800:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783138151.697804:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff95578382cd40) has no exports 00000020:00000080:1.0:1783138151.697951:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955784230800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783138151.698252:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9728d 00000020:00000080:0.0:1783138151.698258:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b1cf6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783138151.698374:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cf6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783138151.698504:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138151.698513:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783138151.698516:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b1cf2800/lustre-QMT0000_UUID 00000020:00000080:0.0:1783138151.698518:0:20784:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cf2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783138151.698527:0:20784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1783138151.733129:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138152.758461:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138153.077111:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138153.077144:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333177728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138153.077220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138153.077327:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333177728 00000100:00100000:0.0:1783138153.077336:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333177728 00000100:00100000:0.0:1783138153.077402:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783138153.077411:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333177728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138153.077442:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138153.077487:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333177728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138153.077494:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783138153.077552:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333177728:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783138153.078218:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783138153.078227:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783138153.078239:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333177856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783138153.078447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138153.078505:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333177856 00000100:00100000:3.0:1783138153.078651:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333177856 00000100:00100000:3.0:1783138153.078696:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783138153.078704:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333177856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783138153.078856:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783138153.078967:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333177856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 264us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138153.078974:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1783138153.078993:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783138153.079021:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333177856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783138153.081927:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333178112:0@lo:400:kworker.0 00000100:00100000:2.0:1783138153.082144:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333178240:0@lo:400:kworker.0 00000100:00100000:2.0:1783138153.082211:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138153.082239:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557840d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869755333178752:0@lo:400:kworker.0 00000100:00100000:2.0:1783138153.082265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138153.082298:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138153.082304:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95588bcd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333178368:0@lo:400:kworker.0 00000100:00100000:2.0:1783138153.082326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138153.082365:0:20004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333178240 00000100:00100000:2.0:1783138153.082373:0:20004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333178240 00000100:00100000:2.0:1783138153.082404:0:20004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333178752 00000100:00100000:2.0:1783138153.082407:0:20004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333178752 00000100:00100000:2.0:1783138153.082430:0:20004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333178368 00000100:00100000:2.0:1783138153.082432:0:20004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333178368 00000100:00100000:2.0:1783138153.082444:0:20004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783138153.082452:0:20004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869755333178752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138153.082502:0:20004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869755333178752:12345-0@lo:400:kworker.0 Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138153.083576:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333177984:0@lo:400:kworker.0 00000100:00100000:3.0:1783138153.083651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138153.083691:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557840d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333178496:0@lo:400:kworker.0 00000100:00100000:3.0:1783138153.083716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783138153.083758:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783138153.083892:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333178496 00000100:00100000:3.0:1783138153.083899:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333178496 00000100:00100000:3.0:1783138153.083939:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783138153.083946:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333178496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138153.083991:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333178496:12345-0@lo:400:kworker.0 Request processed in 46us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138153.083998:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783138153.084013:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783138153.084018:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869755333178240:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783138153.084024:0:17214:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783138153.084082:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869755333178240:12345-0@lo:400:kworker.0 Request processed in 62us (1871us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783138153.084094:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783138153.084108:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783138153.084113:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578411b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869755333178368:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783138153.084118:0:17214:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783138153.084143:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578411b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869755333178368:12345-0@lo:400:kworker.0 Request processed in 29us (1816us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783138153.084149:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1783138153.084162:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783138153.084187:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9557840d2680 x1869755333178496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138153.084200:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557840d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333178496:0@lo:400:kworker.0 00000100:00080000:3.0:1783138153.084227:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783138153.084233:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9558bfa99800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783138153.084237:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1783138153.085929:0:20004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783138153.086013:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333177984 00000100:00100000:2.0:1783138153.086020:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333177984 00000100:00100000:2.0:1783138153.086232:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783138153.086241:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15773131-7634-4f0a-907b-e53392c960ab+19:3647:x1869755333177984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138153.086339:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15773131-7634-4f0a-907b-e53392c960ab+19:3647:x1869755333177984:12345-0@lo:400:kworker.0 Request processed in 100us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138153.086346:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783138153.086403:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333177984:0@lo:400:kworker.0 00000001:00100000:2.0:1783138153.091880:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783138153.091891:0:17192:0:(genops.c:906:class_export_put()) final put ffff9558bfae6800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783138153.091928:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of de261139-79c4-4ea6-bf80-66da3b306ba0 00000001:00080000:2.0:1783138153.091937:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1783138153.091941:0:17192:0:(genops.c:906:class_export_put()) final put ffff9558c1e1d800/de261139-79c4-4ea6-bf80-66da3b306ba0 00000001:00100000:2.0:1783138153.091947:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 58205f1d-e75f-42c6-9ee9-e83bde02d19a 00000001:00080000:2.0:1783138153.091951:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1783138153.091964:0:17192:0:(genops.c:906:class_export_put()) final put ffff9558b1789000/58205f1d-e75f-42c6-9ee9-e83bde02d19a 00000020:00000080:2.0:1783138153.092003:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfae6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1783138153.092388:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558c1e1d800/de261139-79c4-4ea6-bf80-66da3b306ba0 for lustre-MDT0000 00000020:00000080:2.0:1783138153.092419:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1789000/58205f1d-e75f-42c6-9ee9-e83bde02d19a for lustre-MDT0000 00000020:00000080:2.0:1783138153.092444:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558bfae3000 for lustre-MDT0000 00000020:00000080:2.0:1783138153.092448:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558c1e1c000 for lustre-MDT0000 00000020:00000080:2.0:1783138153.092451:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b1788800 for lustre-MDT0000 00000100:00100000:0.0:1783138153.096641:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333178880:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1783138153.097841:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783138153.097858:0:17944:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1783138153.097863:0:17944:0:(genops.c:906:class_export_put()) final put ffff9558bfa86800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783138153.097884:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of de261139-79c4-4ea6-bf80-66da3b306ba0 00000001:00080000:2.0:1783138153.097890:0:17944:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1783138153.097892:0:17944:0:(genops.c:906:class_export_put()) final put ffff9558c1e1a000/de261139-79c4-4ea6-bf80-66da3b306ba0 00000001:00100000:2.0:1783138153.097898:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 58205f1d-e75f-42c6-9ee9-e83bde02d19a 00000001:00080000:2.0:1783138153.097901:0:17944:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1783138153.097903:0:17944:0:(genops.c:906:class_export_put()) final put ffff955781f4f800/58205f1d-e75f-42c6-9ee9-e83bde02d19a 00000020:00000080:2.0:1783138153.097919:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa86800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1783138153.097966:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558c1e1a000/de261139-79c4-4ea6-bf80-66da3b306ba0 for lustre-MDT0001 00000020:00000080:2.0:1783138153.097993:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955781f4f800/58205f1d-e75f-42c6-9ee9-e83bde02d19a for lustre-MDT0001 00000020:00000080:2.0:1783138153.098013:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558bfa83800 for lustre-MDT0001 00000020:00000080:2.0:1783138153.098018:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558c1e1d000 for lustre-MDT0001 00000020:00000080:2.0:1783138153.098022:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955781f4c000 for lustre-MDT0001 00000100:00100000:0.0:1783138153.098677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138153.098776:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333178880 00000100:00100000:0.0:1783138153.100376:0:17218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333178880 00000100:00100000:0.0:1783138153.100441:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783138153.100450:0:17218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869755333178880:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1783138153.100460:0:17218:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783138153.100654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138153.100697:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557840d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869755333178624:0@lo:400:kworker.0 00000100:00100000:1.0:1783138153.100736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138153.100762:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333178624 00000100:00100000:2.0:1783138153.100763:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333178112 00000100:00100000:2.0:1783138153.100767:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333178112 00000100:00100000:1.0:1783138153.100767:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333178624 00000100:00100000:2.0:1783138153.100792:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783138153.100797:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557840d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1869755333178112:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783138153.100803:0:17952:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783138153.100834:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557840d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1869755333178112:12345-0@lo:400:kworker.0 Request processed in 35us (180us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783138153.100841:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783138153.102208:0:17218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869755333178880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1752us (5475us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783138153.102220:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1783138153.102314:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783138153.102318:0:3648:0:(import.c:65:import_set_state_nolock()) ffff95578429c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783138153.102323:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783138153.102329:0:3648:0:(import.c:65:import_set_state_nolock()) ffff95578429c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138153.102333:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1783138153.102341:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff95578429c800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138153.102370:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2c700 x1869755333179008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138153.102412:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333178112:0@lo:400:kworker.0 00000100:00100000:0.0:1783138153.102424:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333179008:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783138153.102458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138153.103024:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783138153.103098:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557840d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1869755333178624:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783138153.103117:0:17214:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783138153.103160:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557840d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1869755333178624:12345-0@lo:400:kworker.0 Request processed in 128us (2423us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783138153.103167:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1783138153.104243:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783138153.104250:0:3648:0:(import.c:65:import_set_state_nolock()) ffff955781f4b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783138153.104254:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783138153.104259:0:3648:0:(import.c:65:import_set_state_nolock()) ffff955781f4b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138153.104264:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 575 00000100:00080000:0.0:1783138153.104273:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff955781f4b000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138153.104304:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2e300 x1869755333179136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138153.104340:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557840d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869755333178624:0@lo:400:kworker.0 00000100:00100000:2.0:1783138153.104464:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333179008 00000100:00100000:2.0:1783138153.104471:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333179008 00000100:00100000:2.0:1783138153.104505:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783138153.104512:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1869755333179008:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1783138153.104525:0:17952:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:02020000:0.0:1783138153.109578:0:3646:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1783138153.109600:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783138153.109605:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff95578429c800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1783138153.110614:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869755333179136:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783138153.110730:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138153.113012:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333179136 00000100:00100000:0.0:1783138153.113040:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333179136 00000100:00100000:0.0:1783138153.113111:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783138153.113120:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557840d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869755333179136:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1783138153.113139:0:17213:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783138153.113222:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557840d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869755333179136:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 102us (2502us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783138153.113230:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783138153.113400:0:3644:0:(import.c:65:import_set_state_nolock()) ffff955781f4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138153.113405:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783138153.113409:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869755333179136:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783138153.136585:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1869755333179008:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31629us (33683us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138153.136601:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1783138153.143682:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578429c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138153.143696:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783138153.143702:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333179008:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1783138153.165657:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9558bfa99800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138153.165673:0:3645:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1783138153.165683:0:3645:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9558bfa99800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138153.165799:0:3645:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578411b100 x1869755333179264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138153.165838:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95588bcd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333178368:0@lo:400:kworker.0 00000100:00080000:2.0:1783138153.165877:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783138153.165881:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9558b1cec000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783138153.165884:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783138153.165888:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9558b1cec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138153.165891:0:3645:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:2.0:1783138153.165895:0:3645:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9558b1cec000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138153.165909:0:3645:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578411a300 x1869755333179392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138153.165919:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333178240:0@lo:400:kworker.0 00010000:00080000:2.0:1783138153.165936:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9557840d1500 x1869755333178752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138153.165946:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557840d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869755333178752:0@lo:400:kworker.0 00000100:00100000:1.0:1783138153.166043:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869755333179264:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783138153.166138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138153.166185:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578411a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869755333179392:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783138153.166207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138153.166255:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333179264 00000100:00100000:1.0:1783138153.166263:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333179264 00000100:00100000:0.0:1783138153.166284:0:19431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333179392 00000100:00100000:0.0:1783138153.166288:0:19431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333179392 00000100:00100000:1.0:1783138153.166323:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783138153.166330:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557840d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869755333179264:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1783138153.166351:0:17214:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783138153.168177:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557840d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869755333179264:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 1836us (2030us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783138153.168191:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783138153.168240:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783138153.168265:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869755333179392:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1783138153.168446:0:17214:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783138153.168489:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869755333179392:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 223us (2281us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783138153.168496:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1783138153.169581:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1cec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138153.169591:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783138153.169596:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869755333179392:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1783138153.169645:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558bfa99800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138153.169650:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783138153.169653:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578411b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869755333179264:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:2.0:1783138153.169838:0:19532:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783138153.169858:0:19532:0:(genops.c:906:class_export_put()) final put ffff9558b17fc000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783138153.169876:0:19532:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58205f1d-e75f-42c6-9ee9-e83bde02d19a 00000020:00000080:2.0:1783138153.169878:0:19532:0:(genops.c:906:class_export_put()) final put ffff9558b17fe000/58205f1d-e75f-42c6-9ee9-e83bde02d19a 00000020:00000080:2.0:1783138153.169896:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b17fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783138153.169934:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b17fe000/58205f1d-e75f-42c6-9ee9-e83bde02d19a for lustre-OST0001 00000020:00000080:2.0:1783138153.169954:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b17ff000 for lustre-OST0001 00000020:00000080:2.0:1783138153.169958:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b17f9800 for lustre-OST0001 00000020:01000000:0.0:1783138153.721457:0:20784:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff95578285f720 - data ffff9558b20e8a20/ffff955883609c00 00000020:01000000:0.0:1783138153.721625:0:20784:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9557829f2ae0 - data ffff9558b219baf8/ffff9558bbf6d800 00000001:00000004:0.0:1783138153.731568:0:20784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:1.0:1783138153.782032:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138153.790806:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783138153.790815:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783138153.790831:0:20784:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff955889f2f480 x1869755333177216/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783138161 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138153.790862:0:20784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783138153.794052:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783138153.794060:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1783138153.794082:0:20784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783138153.794085:0:20784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783138153.794480:0:17236:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783138153.794486:0:17236:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1783138153.794497:0:17236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1783138153.795343:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783138153.795349:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1783138153.795369:0:20784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783138153.795460:0:20784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783138153.795827:0:17238:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783138153.795832:0:17238:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1783138153.795840:0:17238:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1783138153.797128:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9725c 00000020:00000080:2.0:1783138153.797140:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558bfa9f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783138153.798356:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa9f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783138153.800999:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97271 00000020:00000080:2.0:1783138153.801017:0:20784:0:(genops.c:906:class_export_put()) final put ffff955783aee800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783138153.802228:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783138153.802246:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138153.802255:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783138153.802259:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9558b183cd40) has no exports 00000004:01000000:2.0:1783138153.802512:0:20784:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783138153.802522:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e972d3 00000020:00000080:2.0:1783138153.802528:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b1ced000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783138153.802534:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783138153.802537:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138153.802542:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783138153.802545:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff95578277cd40) has no exports 00000020:00000080:2.0:1783138153.802551:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e972cc 00000020:00000080:2.0:1783138153.802555:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b1ce9800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783138153.802789:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955783aee800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1783138153.802799:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1ced000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783138153.802803:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1ce9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783138153.803335:0:20784:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783138153.803341:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783138153.803346:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1783138153.803351:0:20784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783138153.803366:0:20784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783138153.803455:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138153.803463:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783138153.803469:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e972be 00000020:00000080:2.0:1783138153.803485:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b1cf4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783138153.808826:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b1cef000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783138153.808856:0:12391:0:(genops.c:906:class_export_put()) final put ffff9558b1cf2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783138153.808860:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cf2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783138153.808868:0:12391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783138153.809592:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783138153.809601:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138153.809612:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783138153.809617:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff955783a10000) has no exports 00000020:00000080:2.0:1783138153.809795:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e972b7 00000020:00000080:2.0:1783138153.809805:0:20784:0:(genops.c:906:class_export_put()) final put ffff955784230000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783138153.814503:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cf4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1783138153.818341:0:20784:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783138153.818351:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783138153.818356:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1783138153.818365:0:20784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783138153.818368:0:20784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783138153.818420:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138153.818430:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1783138153.818446:0:20784:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783138153.818454:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e972a9 00000020:00000080:2.0:1783138153.818462:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b1cf5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783138153.818468:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1783138153.818868:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138153.818875:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783138153.818880:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff95578382b380) has no exports 00000020:00000080:2.0:1783138153.818887:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e972a2 00000020:00000080:2.0:1783138153.818892:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b1cf9000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783138153.819807:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955784230000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783138153.819820:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558bfb19000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783138153.819827:0:12391:0:(genops.c:906:class_export_put()) final put ffff9558b1cf0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783138153.819853:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cf0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783138153.819858:0:12391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783138153.819937:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cf5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783138153.819942:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cf9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783138153.829885:0:20784:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783138153.829900:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783138153.829905:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783138153.829915:0:20784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783138153.829985:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138153.829998:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783138153.830058:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138153.830063:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783138153.830069:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558b970c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783138153.830074:0:20784:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b970c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783138153.830083:0:20784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783138153.830195:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97278 00000020:00000080:0.0:1783138153.830203:0:20784:0:(genops.c:906:class_export_put()) final put ffff955783aef800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783138153.830208:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783138153.830212:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138153.830216:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783138153.830220:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9557827799c0) has no exports 00000020:00000080:0.0:1783138153.830460:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138153.830465:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783138153.830468:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9727f 00000020:00000080:0.0:1783138153.830473:0:20784:0:(genops.c:906:class_export_put()) final put ffff955783aed000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783138153.830492:0:20784:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95588bc9c800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783138153.830495:0:20784:0:(obd_mount.c:701:lustre_put_lsi()) put ffff95588bc9c800 3 00000020:01000004:0.0:1783138153.830498:0:20784:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95588bc9c800 from lustre-MDT0000 00000020:00000080:0.0:1783138153.830516:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138153.830520:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783138153.830522:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558bfa9b800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783138153.830535:0:20784:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa9b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783138153.830542:0:20784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783138153.830573:0:20784:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783138153.830577:0:20784:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783138153.830581:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783138153.830583:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138153.830586:0:20784:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783138153.830593:0:20784:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9558bfb1a800 15773131-7634-4f0a-907b-e53392c960ab 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783138153.830599:0:20784:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff955783828000) has exports, disconnecting them 00000020:00080000:0.0:1783138153.830603:0:20784:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9558bfb1a800), last request at 1783138058 00000020:00000080:0.0:1783138153.830619:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97224 00000020:00010000:0.0:1783138153.830624:0:20784:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9558bfb1a800: total 2 00000100:00080000:0.0:1783138153.830789:0:20784:0:(import.c:65:import_set_state_nolock()) ffff9558bfb1c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783138153.830814:0:20784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9558bfb1a800): rc 0 00000020:00080000:0.0:1783138153.830819:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff955783828000) has no exports 00000100:00100000:0.0:1783138153.830941:0:17205:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9558839cc200:17205] 0 exiting: rc = 1 00000020:00000080:1.0:1783138153.831165:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b1cfe000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783138153.831174:0:12391:0:(genops.c:906:class_export_put()) final put ffff9558b1cf0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783138153.831177:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cf0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783138153.831185:0:12391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783138153.831256:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955783aef800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783138153.831260:0:12391:0:(genops.c:906:class_export_put()) final put ffff955783ae8800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783138153.831262:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955783ae8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783138153.831265:0:12391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783138153.831292:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955783aed000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1783138153.831423:0:19434:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9558bfb1a800: total 0 00010000:00010000:3.0:1783138153.831428:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138153.831462:0:19434:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9558bfb1a800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783138153.831502:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7157e00/0x6bc248e9a4e975e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e975dc expref: 14 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831518:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff955880031e00/0x6bc248e9a4e97485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e9747e expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831543:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff955880031c00/0x6bc248e9a4e97343 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e9733c expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831556:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff955880030200/0x6bc248e9a4e97351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e9734a expref: 11 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831568:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7156600/0x6bc248e9a4e977e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e977e2 expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831578:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834dec00/0x6bc248e9a4e9735f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e97358 expref: 9 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831594:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95588302a600/0x6bc248e9a4e9760d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e97606 expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831603:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834de600/0x6bc248e9a4e97232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e9722b expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831615:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9764c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e97645 expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831626:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7157400/0x6bc248e9a4e974af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e974a8 expref: 5 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831872:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7156a00/0x6bc248e9a4e977db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e977d4 expref: 4 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831881:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7157800/0x6bc248e9a4e97400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e973f9 expref: 3 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831907:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7156400/0x6bc248e9a4e977f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6bc248e9a4e977f0 expref: 2 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138153.831917:0:19434:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9558bfb1a800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1783138153.831931:0:19434:0:(genops.c:906:class_export_put()) final put ffff9558bfb1a800/15773131-7634-4f0a-907b-e53392c960ab 00010000:00010000:3.0:1783138153.831944:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138153.831946:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138153.831948:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783138153.832415:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfb1a800/15773131-7634-4f0a-907b-e53392c960ab for MGS 00000020:00000080:0.0:1783138153.832450:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558bfb1c800 for MGS 00000100:00100000:2.0:1783138153.838205:0:17206:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff955890842200:17206] 1 exiting: rc = 0 00000100:00100000:2.0:1783138153.840446:0:17207:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9558b106a400:17207] 2 exiting: rc = 0 00000100:00100000:0.0:1783138153.847570:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847581:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847587:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847593:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847599:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847605:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847612:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847619:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847626:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847793:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847798:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847803:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847809:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.847817:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848098:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848104:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848110:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848117:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848123:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848130:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848135:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848141:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848147:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848153:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848158:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848164:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848169:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848175:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848182:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848188:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848195:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848200:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848206:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848211:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848217:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848223:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848228:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848233:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848465:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848471:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848484:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848490:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848496:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848501:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848507:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848512:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848517:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848523:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848528:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848539:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848544:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848550:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848555:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848560:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848566:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848572:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848577:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848581:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848587:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848592:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848598:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848604:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848610:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138153.848615:0:20784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783138153.851427:0:20784:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff95578484ea20 - data ffff9558b22ceca8/ffff9558c1e8dc00 00000020:01000000:1.0:1783138153.851571:0:20784:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9557829f2d80 - data ffff9558b2074360/ffff9558b7396400 00000020:00000080:1.0:1783138153.852590:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97208 00000020:00000080:1.0:1783138153.852600:0:20784:0:(genops.c:906:class_export_put()) final put ffff95578429d000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783138153.852622:0:20784:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95588bc9c800 from MGS, refs=2 00000020:01000004:1.0:1783138153.852625:0:20784:0:(obd_mount.c:701:lustre_put_lsi()) put ffff95588bc9c800 2 00000020:01000004:1.0:1783138153.852765:0:20784:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95588bc9c800 from MGS 00000020:00000080:1.0:1783138153.852798:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138153.852806:0:20784:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783138153.852810:0:20784:0:(genops.c:906:class_export_put()) final put ffff95578429e800/MGS 00000020:00000080:1.0:1783138153.852813:0:20784:0:(genops.c:865:class_export_destroy()) destroying export ffff95578429e800/MGS for MGS 00000020:01000000:1.0:1783138153.852818:0:20784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783138153.852953:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783138153.852957:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138153.852963:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783138153.852970:0:20784:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9558906d5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783138153.852975:0:20784:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9558b18399c0) has exports, disconnecting them 00000020:00080000:1.0:1783138153.852980:0:20784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9558906d5800), last request at 1783138059 00000020:00000080:1.0:1783138153.852983:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9730b 00000020:00080000:1.0:1783138153.852994:0:20784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9558906d5800): rc 0 00000020:00000080:1.0:1783138153.852999:0:20784:0:(genops.c:906:class_export_put()) final put ffff9558906d5800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783138153.857175:0:20784:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783138153.857185:0:20784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783138153.857190:0:20784:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783138153.857199:0:20784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783138153.857404:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138153.857414:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783138153.857422:0:20784:0:(obd_mount.c:701:lustre_put_lsi()) put ffff95588bc9c800 1 00000020:00000080:0.0:1783138153.857429:0:20784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e971fa 00000020:00000080:0.0:1783138153.857437:0:20784:0:(genops.c:906:class_export_put()) final put ffff95578429a800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783138153.857442:0:20784:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783138153.857450:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138153.857454:0:20784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783138153.857458:0:20784:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff955783a14d40) has no exports 00000020:00000080:2.0:1783138153.860814:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff95578429d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783138153.860902:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558906d5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783138153.860910:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955889ec3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783138153.860939:0:8:0:(genops.c:906:class_export_put()) final put ffff9558bfa9f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783138153.860942:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa9f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783138153.860948:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783138153.861459:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff95578429a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783138154.217053:0:20784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138154.217068:0:20784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783138154.217074:0:20784:0:(genops.c:906:class_export_put()) final put ffff95588bc9e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783138154.217080:0:20784:0:(genops.c:865:class_export_destroy()) destroying export ffff95588bc9e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783138154.217090:0:20784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783138154.217555:0:20784:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff95588bc9f000 00000020:02000400:2.0:1783138154.217701:0:20784:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783138154.809290:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138155.830481:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138156.861040:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783138157.186602:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783138157.186614:0:18713:0:(genops.c:906:class_export_put()) final put ffff9558b1cea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783138157.188546:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1cea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783138157.188911:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b1cee000 for lustre-OST0000 00010000:00010000:2.0:1783138157.879214:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783138158.118098:0:20984:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783138158.126869:0:20984:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1783138158.126931:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.126947:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.126956:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.126962:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.127036:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783138158.127044:0:20984:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783138158.127073:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138158.127077:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783138158.127093:0:20984:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783138158.127112:0:20984:0:(import.c:65:import_set_state_nolock()) ffff9558b1cec000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1783138158.127118:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138158.127120:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783138158.127123:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783138158.128664:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.128679:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.128687:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.128693:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.129086:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138158.129094:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.129102:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834de200 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138158.129106:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.129132:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138158.129139:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138158.129145:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783138158.129147:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783138158.129150:0:17201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783138158.129185:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.129192:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138158.129226:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.129234:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9557834de200/0x6bc248e9a4e973f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97400 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.129260:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138158.129264:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138158.130453:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333179520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138158.130522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138158.131330:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333179520 00000100:00100000:0.0:1783138158.131341:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333179520 00000100:00100000:0.0:1783138158.131392:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783138158.131409:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1869755333179520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783138158.131416:0:17197:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783138158 with bad export cookie 7764848875871498788 00010000:00010000:1.0:1783138158.133398:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7024400 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138158.133406:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.133417:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138158.133442:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138158.133449:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783138158.133452:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1783138158.133490:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.133497:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138158.133526:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138158.133539:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138158.133541:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138158.133544:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138158.134834:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783138158.134846:0:20984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9735f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134897:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134905:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134913:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134920:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134947:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138158.134953:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134960:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134966:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134972:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134986:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783138158.134992:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.134998:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.135004:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.135010:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.135017:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1783138158.135020:0:20984:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1783138158.135032:0:20984:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1783138158.135069:0:20984:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1783138158.135073:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1783138158.135077:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138158.135084:0:20984:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1783138158.135091:0:20984:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff955782aa7800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783138158.135096:0:20984:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff955890379000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783138158.135101:0:20984:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9558b5d24d40) has exports, disconnecting them 00000020:00080000:3.0:1783138158.135105:0:20984:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff955782aa7800), last request at 1783138153 00000020:00000080:3.0:1783138158.135112:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97637 00000100:00080000:3.0:1783138158.135130:0:20984:0:(import.c:65:import_set_state_nolock()) ffff955782aa6800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783138158.135172:0:20984:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff955782aa7800): rc 0 00000020:00000080:3.0:1783138158.135174:0:20984:0:(genops.c:906:class_export_put()) final put ffff955782aa7800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1783138158.135184:0:20984:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff955890379000), last request at 1783138153 00000020:00000080:3.0:1783138158.135187:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e974d9 00000100:00080000:3.0:1783138158.135192:0:20984:0:(import.c:65:import_set_state_nolock()) ffff955890378000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783138158.135203:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955782aa7800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1783138158.135256:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955782aa6800 for lustre-MDT0001 00000020:00080000:3.0:1783138158.135279:0:20984:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff955890379000): rc 0 00000020:00000080:3.0:1783138158.135281:0:20984:0:(genops.c:906:class_export_put()) final put ffff955890379000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1783138158.135291:0:20984:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb79741a33ae0 00000020:00000080:3.0:1783138158.135304:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955890379000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783138158.135327:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955890378000 for lustre-MDT0001 00000100:00080000:3.0:1783138158.135346:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138158.135355:0:20984:0:(client.c:3600:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff955889f2d880 x1869755333178880/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783138169 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138158.135370:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783138158.136481:0:20984:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783138158.136501:0:20984:0:(import.c:65:import_set_state_nolock()) ffff95578429c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1783138158.136775:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783138158.136783:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.136796:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c21d2800 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:3.0:1783138158.136800:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.136811:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138158.136817:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138158.136823:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783138158.136825:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783138158.136828:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783138158.136868:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.136875:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138158.136896:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.136902:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558c21d2800/0x6bc248e9a4e97645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e9764c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.136922:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138158.136926:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.136943:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7156800 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:3.0:1783138158.136946:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.136952:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138158.136958:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138158.136962:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783138158.136964:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783138158.136966:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783138158.136982:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.136988:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138158.136995:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.137001:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7156800/0x6bc248e9a4e977f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e977f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.137010:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138158.137014:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.137019:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7025e00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:3.0:1783138158.137021:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.137035:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138158.137041:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138158.137045:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783138158.137047:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783138158.137049:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783138158.137061:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.137067:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138158.137074:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.137080:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7025e00/0x6bc248e9a4e9734a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6bc248e9a4e97351 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138158.137092:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138158.137093:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138158.137096:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138158.137103:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138158.140836:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138158.141059:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558c1e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15773131-7634-4f0a-907b-e53392c960ab:3646:1869755333179904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138158.141149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138158.141198:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333178880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138158.141222:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783138158.141228:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15773131-7634-4f0a-907b-e53392c960ab:3646:1869755333179776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138158.141251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138158.141288:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333179904 00000100:00100000:2.0:1783138158.141295:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333179904 00000100:00100000:2.0:1783138158.141323:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333179776 00000100:00100000:2.0:1783138158.141326:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333179776 00000100:00100000:2.0:1783138158.141338:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138158.141345:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578411b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1869755333179904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783138158.141351:0:17199:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783138158 with bad export cookie 7764848875871498788 00000100:00100000:2.0:1783138158.141413:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578411b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1869755333179904:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (264us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783138158.141419:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138158.141451:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783138158.141456:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578411a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1869755333179776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783138158.141460:0:17199:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783138158 with bad export cookie 7764848875871498788 00000100:00100000:2.0:1783138158.141485:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578411a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1869755333179776:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (234us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783138158.141491:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1783138158.141522:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783138158.141527:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9558bfb1b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783138158.141530:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1783138158.151612:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.106@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783138158.151618:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783138158.151978:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9558b17c6680 x1869755333179520/t0(0) o103->MGC192.168.201.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783138174 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138158.151995:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9558c1e26680 x1869755333179904/t0(0) o103->MGC192.168.201.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783138174 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138158.152005:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff955784fd5180 x1869755333179776/t0(0) o103->MGC192.168.201.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783138174 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783138158.152020:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783138158.152023:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783138158.152025:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783138158.155533:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9558bfb1b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783138158.155540:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15773131-7634-4f0a-907b-e53392c960ab:0:1869755333179648:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783138158.155544:0:3646:0:(import.c:512:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1783138158.155555:0:3646:0:(import.c:626:import_select_connection()) MGC192.168.201.106@tcp: import ffff9558bfb1b800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783138158.155586:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783138158.155591:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558c1e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15773131-7634-4f0a-907b-e53392c960ab:0:1869755333180032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138158.155595:0:3646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95588bcd5180 x1869755333180160/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138158.155679:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558c1e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15773131-7634-4f0a-907b-e53392c960ab:3646:1869755333179904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138158.155709:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15773131-7634-4f0a-907b-e53392c960ab:3646:1869755333179776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138158.155727:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95588bcd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15773131-7634-4f0a-907b-e53392c960ab:3644:1869755333180160:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1783138158.155790:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869755333180160 offset 0 length 520: 4 00000100:00080000:3.0:1783138158.162154:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783138158.162165:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1783138158.162197:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783138158.162259:0:20984:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783138158.162305:0:20984:0:(import.c:65:import_set_state_nolock()) ffff9558bfa85800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783138158.162326:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783138158.162329:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1783138158.162337:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783138158.162489:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:0:1869755333180416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783138158.162543:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558c1e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333180288:0@lo:9:umount.0 00000100:00100000:3.0:1783138158.162619:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138158.162660:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1869755333179520:12345-0@lo:103:ldlm_bl.0 Request processed in 31246us (32132us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783138158.162673:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1783138158.162772:0:20984:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783138158.162783:0:20984:0:(import.c:65:import_set_state_nolock()) ffff955784232800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783138158.162802:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558c1e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333180672:0@lo:9:umount.0 00000100:00100000:0.0:1783138158.162836:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15773131-7634-4f0a-907b-e53392c960ab:3647:1869755333179520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138158.171433:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333180288 00000100:00100000:2.0:1783138158.171451:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333180288 00000100:00100000:2.0:1783138158.171552:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138158.171563:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1869755333180288:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783138158.171594:0:18718:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97503 00000100:00080000:2.0:1783138158.171602:0:18718:0:(import.c:65:import_set_state_nolock()) ffff95578343a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783138158.171662:0:18718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:0.0:1783138158.171856:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783138158.172070:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138158.172116:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333180672 00000100:00100000:1.0:1783138158.172123:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333180672 00000100:00100000:1.0:1783138158.172190:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000020:00080000:3.0:1783138158.172195:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9558b5d24d40) has no exports 00000100:00100000:1.0:1783138158.172202:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1869755333180672:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783138158.172220:0:19281:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97668 00000100:00080000:1.0:1783138158.172235:0:19281:0:(import.c:65:import_set_state_nolock()) ffff9558b178a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783138158.172299:0:19281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1783138158.172462:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3644:x1869755333180672:12345-0@lo:9:umount.0 Request processed in 263us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138158.172471:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1783138158.172499:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783138158.172502:0:3644:0:(import.c:65:import_set_state_nolock()) ffff955784232800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783138158.172524:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783138158.172526:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783138158.172530:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558c1e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333180672:0@lo:9:umount.0 00000100:00080000:3.0:1783138158.172758:0:3645:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9558c1e26680 x1869755333180544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138158.172784:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558c1e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1869755333180544:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783138158.172850:0:17208:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783138158.173685:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138158.176069:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1869755333180288:12345-0@lo:9:umount.0 Request processed in 4500us (13442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138158.176085:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1783138158.176520:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558bfa85800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783138158.176541:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783138158.176543:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783138158.176547:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558c1e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333180288:0@lo:9:umount.0 00000020:00080000:0.0:1783138158.196364:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9558b5d24d40) has no exports 00000100:00080000:3.0:1783138158.197852:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783138158.197860:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783138158.197864:0:8:0:(import.c:65:import_set_state_nolock()) ffff9558bfa99800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138158.197872:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 622 00000100:00080000:3.0:1783138158.197890:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783138158.197897:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9558bfa99800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138158.197932:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558ace49c00 x1869755333180800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138158.197992:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783138158.197996:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783138158.197997:0:8:0:(import.c:65:import_set_state_nolock()) ffff955781f4b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138158.198001:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 622 00000100:00080000:3.0:1783138158.198003:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783138158.198007:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff955781f4b000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138158.198008:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869755333180800:0@lo:38:kworker.0 00000100:00100000:3.0:1783138158.198018:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558ace4a300 x1869755333181056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138158.198065:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138158.198076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138158.198088:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869755333180928:0@lo:400:kworker.0 00000100:00100000:2.0:1783138158.198110:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869755333181056:0@lo:38:kworker.0 00000100:00100000:3.0:1783138158.198128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138158.198784:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869755333181184:0@lo:400:kworker.0 00000100:00100000:1.0:1783138158.198823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138158.209225:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333180800 00000100:00100000:2.0:1783138158.209241:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333180800 00000100:00100000:2.0:1783138158.209308:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333180928 00000100:00100000:2.0:1783138158.209312:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333180928 00000100:00100000:2.0:1783138158.209331:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333181184 00000100:00100000:2.0:1783138158.209334:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333181184 00000100:00100000:2.0:1783138158.209353:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783138158.209362:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869755333180800:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783138158.209390:0:17213:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783138158.210381:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783138158.210390:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869755333180928:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783138158.210399:0:19431:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783138158.210494:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869755333180928:12345-0@lo:400:kworker.0 Request processed in 103us (12365us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783138158.210501:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783138158.210519:0:19431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783138158.210523:0:19431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869755333181184:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783138158.210528:0:19431:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783138158.210554:0:19431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869755333181184:12345-0@lo:400:kworker.0 Request processed in 29us (11732us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783138158.210569:0:19431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1783138158.210738:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783138158.211758:0:3645:0:(import.c:65:import_set_state_nolock()) ffff95589037f000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783138158.211766:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783138158.212559:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783138158.212565:0:3647:0:(import.c:65:import_set_state_nolock()) ffff955782aa7000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783138158.212568:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783138158.212574:0:3647:0:(import.c:65:import_set_state_nolock()) ffff955782aa7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138158.212578:0:3647:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 575 00000100:00080000:1.0:1783138158.212587:0:3647:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff955782aa7000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783138158.212643:0:3647:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558b17c6680 x1869755333181312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138158.212664:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869755333181184:0@lo:400:kworker.0 00000100:00100000:2.0:1783138158.242488:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138158.242567:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869755333181312:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783138158.242654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138158.242725:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869755333180800:12345-0@lo:38:kworker.0 Request processed in 33362us (44647us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138158.242735:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1783138158.242796:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558bfa99800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138158.242802:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138158.242806:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869755333180800:0@lo:38:kworker.0 00000100:00100000:2.0:1783138158.242828:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333181056 00000100:00100000:2.0:1783138158.242835:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333181056 00000100:00100000:2.0:1783138158.242863:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333181312 00000100:00100000:2.0:1783138158.242866:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333181312 00000100:00100000:2.0:1783138158.242881:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783138158.242888:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333181056:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783138158.242910:0:17212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783138158.242944:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333181056:12345-0@lo:38:kworker.0 Request processed in 55us (459us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783138158.242949:0:20004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783138158.242959:0:20004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1869755333181312:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783138158.242964:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:02000000:1.0:1783138158.242974:0:20004:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1783138158.242997:0:3644:0:(import.c:65:import_set_state_nolock()) ffff955781f4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138158.243003:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138158.243007:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869755333181056:0@lo:38:kworker.0 00000100:00100000:1.0:1783138158.243624:0:20004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1869755333181312:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 663us (993us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783138158.243657:0:20004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1783138158.245104:0:3644:0:(import.c:65:import_set_state_nolock()) ffff955782aa7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138158.245115:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138158.245120:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869755333181312:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1783138158.279723:0:3645:0:(import.c:65:import_set_state_nolock()) ffff95589037f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138158.279741:0:3645:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1783138158.279751:0:3645:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff95589037f000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138158.282178:0:3645:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955784069c00 x1869755333181440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138158.282218:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869755333180928:0@lo:400:kworker.0 00000020:01000000:1.0:1783138158.287835:0:20984:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff955782bba8a0 - data ffff9558b2278bd0/ffff95578270d800 00000020:01000000:1.0:1783138158.287984:0:20984:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9558ba68ea20 - data ffff9558b2161948/ffff9558bba1a800 00000100:00100000:3.0:1783138158.290762:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869755333181440:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783138158.291005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138158.292764:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333181440 00000100:00100000:2.0:1783138158.292777:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333181440 00000100:00100000:2.0:1783138158.292981:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783138158.292989:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333181440:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1783138158.293011:0:17212:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783138158.293090:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333181440:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 100us (2085us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138158.293096:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1783138158.294741:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95589037f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138158.294753:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783138158.294758:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869755333181440:0@lo:38:ptlrpcd_00_00.0 00000001:00000004:1.0:1783138158.303467:0:20984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:1.0:1783138158.372543:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783138158.372552:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783138158.372561:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783138158.377905:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783138158.377915:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1783138158.377942:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783138158.377945:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783138158.378833:0:17953:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783138158.378839:0:17953:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1783138158.378851:0:17953:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1783138158.379827:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783138158.379833:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1783138158.380013:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783138158.380017:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783138158.380401:0:17955:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783138158.380405:0:17955:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1783138158.380419:0:17955:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1783138158.383004:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9736d 00000020:00000080:1.0:1783138158.383017:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558bfa85000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783138158.383344:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa85000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783138158.385906:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97382 00000020:00000080:1.0:1783138158.385919:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558b97ff000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783138158.385982:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1783138158.385990:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138158.385999:0:20984:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783138158.386004:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9558b183b380) has no exports 00000004:01000000:1.0:1783138158.386226:0:20984:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783138158.386236:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e973d6 00000020:00000080:1.0:1783138158.386241:0:20984:0:(genops.c:906:class_export_put()) final put ffff955782beb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138158.387431:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b97ff000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783138158.391593:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783138158.391647:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138158.391663:0:20984:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783138158.391669:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff955782778000) has no exports 00000020:00000080:1.0:1783138158.391682:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e973cf 00000020:00000080:1.0:1783138158.391716:0:20984:0:(genops.c:906:class_export_put()) final put ffff955784233000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783138158.391826:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955782beb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1783138158.392564:0:20984:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783138158.392569:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783138158.392574:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1783138158.392579:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783138158.392582:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783138158.392619:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955784233000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783138158.393072:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138158.393083:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138158.393097:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e973c1 00000020:00000080:1.0:1783138158.393103:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558943d9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138158.393127:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955784232800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783138158.393133:0:8:0:(genops.c:906:class_export_put()) final put ffff9558b97fb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138158.393136:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b97fb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1783138158.393141:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783138158.393347:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783138158.393353:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138158.393359:0:20984:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783138158.393363:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9558b5d20000) has no exports 00000020:00000080:1.0:1783138158.393369:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e973b3 00000020:00000080:1.0:1783138158.393374:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558bfa82800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783138158.393398:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558943d9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1783138158.394028:0:20984:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783138158.394033:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783138158.394037:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1783138158.394042:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783138158.394044:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783138158.394702:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa82800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783138158.395180:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138158.395198:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1783138158.395213:0:20984:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783138158.395222:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e973a5 00000020:00000080:1.0:1783138158.395231:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558b5d3d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138158.395307:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558bfa85800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783138158.395314:0:8:0:(genops.c:906:class_export_put()) final put ffff9558b97fe800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138158.395316:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b97fe800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1783138158.395322:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783138158.395434:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1783138158.395439:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138158.395446:0:20984:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783138158.395450:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9558b71a3380) has no exports 00000020:00000080:1.0:1783138158.395456:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9739e 00000020:00000080:1.0:1783138158.395462:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558b5d3f800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783138158.395905:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b5d3d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783138158.395921:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b5d3f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1783138158.418935:0:20984:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1783138158.418948:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783138158.418953:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783138158.418965:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783138158.419175:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138158.419258:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138158.419289:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138158.419294:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138158.419299:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558bfa84000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783138158.419304:0:20984:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa84000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783138158.419313:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138158.419474:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97389 00000020:00000080:1.0:1783138158.419481:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558b97fd000/lustre-MDD0001_UUID 00000020:00000080:3.0:1783138158.420285:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff95578429c800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783138158.420295:0:8:0:(genops.c:906:class_export_put()) final put ffff9558b5d3c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138158.420298:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b5d3c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1783138158.420307:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783138158.420485:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1783138158.420491:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138158.420498:0:20984:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783138158.420502:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9558b5d219c0) has no exports 00000020:00000080:1.0:1783138158.420525:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138158.420530:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1783138158.420535:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97390 00000020:00000080:1.0:1783138158.420540:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558b97ff800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783138158.420568:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b97fd000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1783138158.420572:0:8:0:(genops.c:906:class_export_put()) final put ffff9558bfa83000/lustre-MDD0001_UUID 00000020:00000080:3.0:1783138158.420575:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa83000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1783138158.420578:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:1.0:1783138158.421056:0:20984:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9557828ce800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1783138158.421062:0:20984:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9557828ce800 2 00000020:01000004:1.0:1783138158.421065:0:20984:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9557828ce800 from lustre-MDT0001 00000020:00000080:1.0:1783138158.421086:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138158.421092:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1783138158.421095:0:20984:0:(genops.c:906:class_export_put()) final put ffff9558bfa80800/lustre-MDT0001_UUID 00000020:00000080:1.0:1783138158.421097:0:20984:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfa80800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1783138158.421105:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1783138158.421147:0:20984:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1783138158.421151:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1783138158.421154:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138158.421168:0:20984:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783138158.421174:0:20984:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff955890cc9800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783138158.421179:0:20984:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9558a6134d40) has exports, disconnecting them 00000020:00080000:1.0:1783138158.421183:0:20984:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff955890cc9800), last request at 1783138076 00000020:00000080:1.0:1783138158.421247:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9740e 00000020:00080000:1.0:1783138158.421255:0:20984:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff955890cc9800): rc 0 00000020:00000080:1.0:1783138158.421259:0:20984:0:(genops.c:906:class_export_put()) final put ffff955890cc9800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783138158.421276:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b97ff800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1783138158.423061:0:20984:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1783138158.423069:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783138158.423074:0:20984:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783138158.423081:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783138158.423456:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955890cc9800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783138158.424088:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138158.424098:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1783138158.424106:0:20984:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9557828ce800 1 00000020:00000080:1.0:1783138158.424113:0:20984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97335 00000020:00000080:1.0:1783138158.424122:0:20984:0:(genops.c:906:class_export_put()) final put ffff9557828cc800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783138158.424409:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b1cec000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783138158.424417:0:8:0:(genops.c:906:class_export_put()) final put ffff955883974000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1783138158.424420:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955883974000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1783138158.424425:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:1.0:1783138158.424551:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1783138158.424556:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138158.424562:0:20984:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783138158.424566:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff95578277b380) has no exports 00000020:00000080:3.0:1783138158.433971:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9557828cc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783138158.513480:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138158.513496:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783138158.513503:0:20984:0:(genops.c:906:class_export_put()) final put ffff9557828ce000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783138158.513509:0:20984:0:(genops.c:865:class_export_destroy()) destroying export ffff9557828ce000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783138158.513523:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783138158.513733:0:20984:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9557828c9800 00000020:01000000:3.0:1783138158.513817:0:20984:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783138158.513821:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138158.513824:0:20984:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783138158.513828:0:20984:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9557838299c0) has no exports 00000100:00100000:1.0:1783138158.514045:0:20004:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff955783680600:20004] 4 exiting: rc = 0 00000100:00100000:3.0:1783138158.514519:0:17214:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9558b49afc00:17214] 2 exiting: rc = 0 00000100:00100000:3.0:1783138158.514746:0:17213:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff955882cc0000:17213] 1 exiting: rc = 0 00000100:00100000:2.0:1783138158.514935:0:19431:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9557810ffc00:19431] 3 exiting: rc = 0 00000100:00100000:2.0:1783138158.515057:0:17212:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9558b72f0c00:17212] 0 exiting: rc = 1 00000100:00100000:3.0:1783138158.515323:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515331:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515336:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515342:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515347:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515353:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515359:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515363:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515368:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515373:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515378:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515384:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515389:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515395:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515400:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515406:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515412:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515418:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515423:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515429:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515434:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515439:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515445:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515451:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515456:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515461:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515466:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515472:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515477:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515482:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515488:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515493:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515501:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515505:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515510:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515528:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515534:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515538:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515543:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515548:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515553:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515558:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515563:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515568:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515573:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515578:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515583:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515588:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515594:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515598:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515604:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515610:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515616:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515621:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515667:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515675:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515680:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515684:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515700:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515707:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515712:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515718:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515725:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.515730:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.544218:0:17216:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff955783914c00:17216] 1 exiting: rc = 0 00000100:00100000:3.0:1783138158.544939:0:17215:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff955783914600:17215] 0 exiting: rc = 1 00000100:00100000:1.0:1783138158.552502:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552514:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552534:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552540:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552546:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552552:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552558:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552564:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552571:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552592:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552597:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552602:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552607:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552612:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552618:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.552623:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555496:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555520:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555526:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555531:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555537:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555543:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555548:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555554:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555559:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555565:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555569:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555574:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555580:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555586:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555591:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555596:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555602:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555607:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555612:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555617:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555622:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555651:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555658:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555663:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555668:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555673:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555678:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555684:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555718:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555723:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555727:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555732:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555738:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555744:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555749:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555754:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555758:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555764:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555769:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555775:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555780:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555785:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555790:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555795:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555800:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555806:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555810:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.555815:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.559644:0:17217:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9558ba774000:17217] 0 exiting: rc = 1 00000100:00100000:2.0:1783138158.559768:0:17952:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9558ba5b6400:17952] 2 exiting: rc = 0 00000100:00100000:3.0:1783138158.560457:0:17218:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9558ba775c00:17218] 1 exiting: rc = 0 00000100:00100000:1.0:1783138158.560576:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560593:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560600:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560606:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560613:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560618:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560624:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560657:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560667:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560673:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560680:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560699:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560708:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560732:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560740:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560760:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560766:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560772:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560778:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560784:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560790:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560799:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560806:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560812:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560817:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560840:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560849:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560857:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560865:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560873:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560881:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560890:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560899:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560908:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560916:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560924:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560932:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560962:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560971:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560979:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560987:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.560994:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561000:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561007:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561015:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561373:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561383:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561389:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561395:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561416:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561429:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561435:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561441:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561446:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561453:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561459:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561466:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561472:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561478:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561483:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561489:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561495:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561501:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.561510:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.580404:0:17219:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9558b49aec00:17219] 0 exiting: rc = 1 00000100:00100000:3.0:1783138158.580512:0:17220:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff955889310800:17220] 1 exiting: rc = 0 00000100:00100000:1.0:1783138158.584443:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584457:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584465:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584473:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584482:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584489:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584496:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584503:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584511:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584518:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584527:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584534:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584542:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584550:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584557:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584565:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584574:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584582:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584590:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584601:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584611:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584714:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584721:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584727:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584820:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584831:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584836:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584841:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584847:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584851:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584855:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584860:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584865:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584870:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584875:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584879:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584885:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584889:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584894:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584899:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584905:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584911:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584915:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584920:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584926:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584932:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584937:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584944:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584952:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584960:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584968:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584978:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584986:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.584995:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585001:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585006:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585019:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585145:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585165:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585175:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585351:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585361:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585368:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138158.585375:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.586123:0:17222:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9558ba779200:17222] 1 exiting: rc = 0 00000100:00100000:3.0:1783138158.586265:0:17221:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9558ba779c00:17221] 0 exiting: rc = 1 00000100:00100000:2.0:1783138158.586332:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586339:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586345:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586351:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586356:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586362:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586367:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586372:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586386:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586391:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586396:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586401:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586407:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586412:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586417:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586423:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586428:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586434:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586439:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586444:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586448:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586453:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586457:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586461:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586465:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586470:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586475:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586479:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586484:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586502:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586508:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586514:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586519:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586524:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586528:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586533:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586538:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586544:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586550:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586555:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586560:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586565:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586569:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586583:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586588:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586592:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586597:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586602:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586607:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586611:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586886:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586894:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586899:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586904:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586909:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586914:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586919:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586924:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586929:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586934:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586938:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586943:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586948:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.586953:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.587927:0:17223:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9558ba778c00:17223] 0 exiting: rc = 1 00000100:00100000:1.0:1783138158.588432:0:17224:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9558ba779800:17224] 1 exiting: rc = 0 00000100:00100000:2.0:1783138158.588837:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588846:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588852:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588857:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588862:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588867:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588872:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588877:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588883:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588888:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588892:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588898:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588903:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588908:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588924:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588929:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588934:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588939:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588944:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588949:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588954:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588959:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588963:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588968:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588973:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588978:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588982:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588986:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588991:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588995:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.588999:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589004:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589009:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589014:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589019:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589023:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589028:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589032:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589037:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589041:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589046:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589050:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589055:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589059:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589064:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589069:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589073:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589078:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589083:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589093:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589098:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589103:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589107:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589112:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589118:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589123:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589128:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589133:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589138:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589142:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589147:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589151:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589156:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.589162:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138158.591823:0:17226:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9558b4aa9200:17226] 1 exiting: rc = 0 00000100:00100000:0.0:1783138158.592089:0:17227:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9558b4b45e00:17227] 2 exiting: rc = 0 00000100:00100000:1.0:1783138158.595967:0:17225:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff955783914e00:17225] 0 exiting: rc = 1 00000100:00100000:2.0:1783138158.599740:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599758:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599770:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599783:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599794:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599804:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599817:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599829:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599841:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599852:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599864:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599876:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599888:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599900:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599911:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599923:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599934:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599941:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599952:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.599999:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600020:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600027:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600037:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600048:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600058:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600067:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600077:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600089:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600101:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600113:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600125:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600136:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600148:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600155:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600161:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600173:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600182:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600206:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600218:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600229:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600241:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600253:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600264:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600308:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600321:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600333:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600344:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600354:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600366:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600377:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600388:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600400:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600410:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600421:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600432:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600450:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600462:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600473:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600484:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600494:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600504:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600515:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600526:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138158.600537:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783138158.616029:0:20984:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138158.616041:0:20984:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783138158.616046:0:20984:0:(genops.c:906:class_export_put()) final put ffff95578429c000/MDS_uuid 00000020:00000080:2.0:1783138158.616051:0:20984:0:(genops.c:865:class_export_destroy()) destroying export ffff95578429c000/MDS_uuid for MDS 00000020:01000000:2.0:1783138158.616061:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783138158.616307:0:20984:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1783138158.908543:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138159.924962:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138160.950068:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138161.973160:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783138162.518571:0:21186:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783138162.546898:0:21186:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783138162.546963:0:21186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.546980:0:21186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.546987:0:21186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.546993:0:21186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.547025:0:21186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783138162.547031:0:21186:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783138162.547067:0:21186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783138162.547072:0:21186:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783138162.547078:0:21186:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783138162.547083:0:21186:0:(import.c:65:import_set_state_nolock()) ffff9558bfa99800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783138162.547089:0:21186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783138162.547091:0:21186:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783138162.547107:0:21186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783138162.547288:0:19434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138162.547296:0:19434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.547303:0:19434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834dfa00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138162.547307:0:19434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.547316:0:19434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138162.547324:0:19434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138162.547330:0:19434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783138162.547333:0:19434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783138162.547336:0:19434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783138162.547357:0:19434:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9558bfb1b800 00010000:00010000:2.0:1783138162.547361:0:19434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.547369:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9557834dfa00/0x6bc248e9a4e974a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e974af expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.547383:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138162.547385:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138162.547387:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783138162.550127:0:21186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783138162.550137:0:21186:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783138162.550144:0:21186:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783138162.550151:0:21186:0:(import.c:65:import_set_state_nolock()) ffff95589037f000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783138162.550157:0:21186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783138162.550159:0:21186:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783138162.550162:0:21186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783138162.552060:0:21186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.552081:0:21186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.552089:0:21186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.552096:0:21186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.552120:0:21186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138162.552128:0:21186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.552133:0:21186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.552137:0:21186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.552167:0:21186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138162.552201:0:21186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783138162.552207:0:21186:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1783138162.552237:0:21186:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783138162.552242:0:21186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1783138162.552246:0:21186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138162.552252:0:21186:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783138162.552258:0:21186:0:(genops.c:1840:print_export_data()) lustre-OST0000: UNLINKED ffff95578343b000 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 8589934593 stale:0 00000020:00080000:0.0:1783138162.552265:0:21186:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9558b71a4d40) has no exports 00000020:00080000:0.0:1783138162.552287:0:21186:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9558b71a4d40) has no exports 00010000:00010000:2.0:1783138162.552969:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138162.552978:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.552986:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834dfc00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138162.552989:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.552999:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138162.553007:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138162.553013:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783138162.553015:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1783138162.553018:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1783138162.553032:0:17200:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9558bfb1b800 00010000:00010000:2.0:1783138162.553036:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.553057:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9557834dfc00/0x6bc248e9a4e9747e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e97485 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.553082:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138162.553084:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.553090:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7157000 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138162.553092:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.553098:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138162.553104:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138162.553109:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783138162.553111:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783138162.553113:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783138162.553118:0:17200:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9558bfb1b800 00010000:00010000:2.0:1783138162.553121:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.553126:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7157000/0x6bc248e9a4e977e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e977e9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138162.553135:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138162.553136:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138162.553143:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138162.555116:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138162.996877:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783138163.322941:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) 15773131-7634-4f0a-907b-e53392c960ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783138163.322952:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) 15773131-7634-4f0a-907b-e53392c960ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138163.322956:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783138163.322960:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783138163.322964:0:38:0:(import.c:65:import_set_state_nolock()) ffff955781f4b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138163.322972:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 627 00000100:00080000:0.0:1783138163.322978:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783138163.322985:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff955781f4b000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138163.323026:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2d180 x1869755333181568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138163.323051:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783138163.323055:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783138163.323056:0:38:0:(import.c:65:import_set_state_nolock()) ffff955782aa7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138163.323073:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 627 00000100:00080000:0.0:1783138163.323075:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138163.323079:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff955782aa7000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138163.323092:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2ea00 x1869755333181696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138163.323148:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869755333181568:0@lo:38:kworker.0 00000400:00000100:1.0:1783138163.323201:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755333181568 offset 0 length 520: 4 00000100:00100000:1.0:1783138163.323265:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869755333181696:0@lo:38:kworker.0 00000400:00000100:1.0:1783138163.323282:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755333181696 offset 0 length 520: 4 00000001:00100000:3.0:1783138163.832308:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783138163.832314:0:19532:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138163.832319:0:18713:0:(genops.c:906:class_export_put()) final put ffff95578343b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783138163.832321:0:19532:0:(genops.c:906:class_export_put()) final put ffff9558b178b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783138163.832418:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff95578343b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783138163.832465:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b178b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783138163.832483:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff95578343a000 for lustre-OST0000 00000020:00000080:0.0:1783138163.832498:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558b178a800 for lustre-OST0001 00010000:00010000:2.0:1783138164.020937:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783138164.596959:0:21186:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff95588536c2a0 - data ffff9558b208b0d8/ffff955782712800 00000020:01000000:0.0:1783138164.597101:0:21186:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff955782b39f60 - data ffff9558b22656c0/ffff9558b6cf5c00 00100000:10000000:0.0:1783138164.604739:0:21186:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783138164.622044:0:21186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97493 00000020:00000080:1.0:1783138164.622180:0:21186:0:(genops.c:906:class_export_put()) final put ffff9558b178d800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783138164.622397:0:21186:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9558b6f57000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783138164.622402:0:21186:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9558b6f57000 2 00000020:01000004:1.0:1783138164.622405:0:21186:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9558b6f57000 from lustre-OST0000 00000020:00000080:1.0:1783138164.622441:0:21186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138164.622451:0:21186:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783138164.622454:0:21186:0:(genops.c:906:class_export_put()) final put ffff9558b178b800/lustre-OST0000_UUID 00000020:00000080:1.0:1783138164.622458:0:21186:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b178b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783138164.622464:0:21186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783138164.622512:0:21186:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783138164.622516:0:21186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783138164.622519:0:21186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138164.622535:0:21186:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783138164.622541:0:21186:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff955890754800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783138164.622546:0:21186:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff955783a119c0) has exports, disconnecting them 00000020:00080000:1.0:1783138164.622551:0:21186:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff955890754800), last request at 1783138090 00000020:00000080:1.0:1783138164.622555:0:21186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e974bd 00000020:00080000:1.0:1783138164.622565:0:21186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff955890754800): rc 0 00000020:00000080:1.0:1783138164.622570:0:21186:0:(genops.c:906:class_export_put()) final put ffff955890754800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783138164.622710:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b178d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783138164.624792:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff955890754800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783138164.627723:0:21186:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783138164.627735:0:21186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783138164.627740:0:21186:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783138164.627747:0:21186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783138164.627927:0:21186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138164.627936:0:21186:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1783138164.627943:0:21186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783138164.627951:0:21186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138164.627955:0:21186:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783138164.627963:0:21186:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff95589037d000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783138164.627970:0:21186:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff9558a6133380) has exports, disconnecting them 00000020:00080000:2.0:1783138164.627974:0:21186:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff95589037d000), last request at 1783138090 00000020:00000080:2.0:1783138164.627978:0:21186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e974d2 00000020:00080000:2.0:1783138164.627997:0:21186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff95589037d000): rc 0 00000020:00000080:2.0:1783138164.628014:0:21186:0:(genops.c:906:class_export_put()) final put ffff95589037d000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783138164.628899:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558bfa99800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783138164.628910:0:8:0:(genops.c:906:class_export_put()) final put ffff9558b1ce8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783138164.628913:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b1ce8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783138164.628919:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1783138164.628988:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff95589037d000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1783138164.629028:0:21186:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783138164.629032:0:21186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783138164.629036:0:21186:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783138164.629040:0:21186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783138164.629400:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff95589037f000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783138164.629516:0:21186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138164.629523:0:21186:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1783138164.629527:0:21186:0:(genops.c:906:class_export_put()) final put ffff95589037b000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1783138164.629530:0:21186:0:(genops.c:865:class_export_destroy()) destroying export ffff95589037b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1783138164.629534:0:21186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1783138164.629566:0:21186:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9558b6f57000 1 00000020:00000080:3.0:1783138164.629571:0:21186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97470 00000020:00000080:3.0:1783138164.629577:0:21186:0:(genops.c:906:class_export_put()) final put ffff9558b6f57800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1783138164.629596:0:21186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1783138164.629604:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b6f57800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783138164.629613:0:21186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138164.629617:0:21186:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783138164.629650:0:21186:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9558b71a0000) has no exports 00000020:00000080:1.0:1783138164.722086:0:21186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138164.722100:0:21186:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1783138164.722105:0:21186:0:(genops.c:906:class_export_put()) final put ffff9558b6f53800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783138164.722110:0:21186:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b6f53800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1783138164.722123:0:21186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1783138164.722257:0:21186:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9558b6f53000 00000020:02000400:1.0:1783138164.722308:0:21186:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783138165.044957:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138166.069067:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138167.095534:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138168.117136:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783138168.436933:0:12391:0:(pinger.c:231:ptlrpc_pinger_process_import()) 15773131-7634-4f0a-907b-e53392c960ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783138168.436942:0:12391:0:(pinger.c:249:ptlrpc_pinger_process_import()) 15773131-7634-4f0a-907b-e53392c960ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138168.436946:0:12391:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783138168.436949:0:12391:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138168.436952:0:12391:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783138168.436955:0:12391:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783138168.437034:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138158/real 1783138158] req@ffff95588bcd5180 x1869755333180160/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783138168 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138168.437065:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95588bcd5180 x1869755333180160/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783138168 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783138168.437087:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558bfb1b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138168.437106:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1783138168.437111:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95588bcd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15773131-7634-4f0a-907b-e53392c960ab:3644:1869755333180160:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1783138168.437558:0:12391:0:(pinger.c:231:ptlrpc_pinger_process_import()) 15773131-7634-4f0a-907b-e53392c960ab->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783138168.437562:0:12391:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783138168.437565:0:12391:0:(import.c:65:import_set_state_nolock()) ffff9558bfb1b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138168.437570:0:12391:0:(import.c:512:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 627 00000100:00080000:2.0:1783138168.437575:0:12391:0:(import.c:591:import_select_connection()) MGC192.168.201.106@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783138168.437581:0:12391:0:(import.c:626:import_select_connection()) MGC192.168.201.106@tcp: import ffff9558bfb1b800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138168.437611:0:12391:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955784068380 x1869755333181824/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138168.437656:0:12391:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783138168.437660:0:12391:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138168.437663:0:12391:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783138168.437665:0:12391:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783138168.437700:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15773131-7634-4f0a-907b-e53392c960ab:3644:1869755333181824:0@lo:250:kworker.0 00000400:00000100:1.0:1783138168.437746:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869755333181824 offset 0 length 520: 4 00000020:01000004:3.0:1783138168.482309:0:21387:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783138168.499911:0:21387:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1783138168.499980:0:21387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.499993:0:21387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.499997:0:21387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.500001:0:21387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.500022:0:21387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783138168.500025:0:21387:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783138168.500043:0:21387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138168.500051:0:21387:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff955889f2d180 x1869755333181568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138168.500063:0:21387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783138168.500067:0:21387:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783138168.500072:0:21387:0:(import.c:65:import_set_state_nolock()) ffff955781f4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783138168.500075:0:21387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138168.500078:0:21387:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff955889f2d180 x1869755333181568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138183 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138168.500083:0:21387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783138168.500086:0:21387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1783138168.500110:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869755333181568:0@lo:38:kworker.0 00010000:00010000:0.0:1783138168.500139:0:19434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138168.500145:0:19434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138168.500152:0:19434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c21d3a00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:0.0:1783138168.500155:0:19434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138168.500169:0:19434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138168.500177:0:19434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138168.500185:0:19434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783138168.500188:0:19434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783138168.500191:0:19434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783138168.500211:0:19434:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9558bfb1b800 00010000:00010000:0.0:1783138168.500214:0:19434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138168.500219:0:19434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558c21d3a00/0x6bc248e9a4e97606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e9760d expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138168.500229:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138168.500231:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138168.500232:0:19434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783138168.501472:0:21387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783138168.501491:0:21387:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff955889f2ea00 x1869755333181696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138168.501558:0:21387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783138168.501564:0:21387:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783138168.501568:0:21387:0:(import.c:65:import_set_state_nolock()) ffff955782aa7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783138168.501573:0:21387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783138168.501578:0:21387:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff955889f2ea00 x1869755333181696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138178 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138168.501880:0:21387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783138168.501911:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869755333181696:0@lo:38:kworker.0 00000100:00100000:3.0:1783138168.502011:0:21387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783138168.503378:0:21387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.503397:0:21387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.503404:0:21387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.503411:0:21387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.503442:0:21387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138168.503450:0:21387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.503457:0:21387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.503482:0:21387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.503488:0:21387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138168.503576:0:21387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783138168.503581:0:21387:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1783138168.503608:0:21387:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1783138168.503617:0:21387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1783138168.503623:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138168.503655:0:21387:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783138168.503660:0:21387:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9558a61319c0) has no exports 00000020:00080000:3.0:1783138168.503694:0:21387:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9558a61319c0) has no exports 00010000:00010000:1.0:1783138168.506452:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138168.506466:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138168.506478:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df400 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138168.506482:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138168.506492:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138168.506500:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138168.506505:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783138168.506508:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1783138168.506511:0:17201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1783138168.506537:0:17201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9558bfb1b800 00010000:00010000:1.0:1783138168.506541:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138168.506547:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9557834df400/0x6bc248e9a4e975dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e975e3 expref: -99 pid: 19531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138168.506562:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138168.506566:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138168.506572:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302b400 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138168.506591:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138168.506599:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138168.506605:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138168.506610:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783138168.506612:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783138168.506614:0:17201:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783138168.506619:0:17201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9558bfb1b800 00010000:00010000:1.0:1783138168.506621:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138168.506640:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e977d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e977db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138168.506653:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138168.506654:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138168.506656:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783138168.507793:0:21387:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff95588536c960 - data ffff9558b208b360/ffff9558c1e8a400 00000020:01000000:3.0:1783138168.507969:0:21387:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff95588536c000 - data ffff9558b20b71b0/ffff955883610400 00010000:00010000:2.0:1783138168.510385:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1783138168.517670:0:21387:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783138168.524839:0:21387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e975f1 00000020:00000080:2.0:1783138168.524851:0:21387:0:(genops.c:906:class_export_put()) final put ffff955782aa3000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1783138168.524903:0:21387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9557825f9800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1783138168.524907:0:21387:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9557825f9800 2 00000020:01000004:2.0:1783138168.524911:0:21387:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9557825f9800 from lustre-OST0001 00000020:00000080:2.0:1783138168.524940:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138168.524949:0:21387:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1783138168.524953:0:21387:0:(genops.c:906:class_export_put()) final put ffff9558b6dfb800/lustre-OST0001_UUID 00000020:00000080:2.0:1783138168.524957:0:21387:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b6dfb800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1783138168.524965:0:21387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1783138168.525181:0:21387:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 15773131-7634-4f0a-907b-e53392c960ab->MGS 00010000:00010000:2.0:1783138168.525196:0:21387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7024a00/0x6bc248e9a4e9733c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e97343 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138168.525208:0:21387:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7024a00/0x6bc248e9a4e9733c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e97343 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138168.525215:0:21387:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1783138168.525218:0:21387:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1783138168.525221:0:21387:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1783138168.525235:0:21387:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9558bfb1b800 00010000:00010000:2.0:1783138168.525239:0:21387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7024a00/0x6bc248e9a4e9733c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e97343 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138168.525266:0:21387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff955880031000/0x6bc248e9a4e9722b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6bc248e9a4e97232 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138168.525272:0:21387:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff955880031000/0x6bc248e9a4e9722b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6bc248e9a4e97232 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138168.525278:0:21387:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783138168.525280:0:21387:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1783138168.525282:0:21387:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1783138168.525296:0:21387:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9558bfb1b800 00010000:00010000:2.0:1783138168.525299:0:21387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff955880031000/0x6bc248e9a4e9722b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6bc248e9a4e97232 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783138168.525324:0:21387:0:(import.c:65:import_set_state_nolock()) ffff9558bfb1b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1783138168.525328:0:21387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783138168.525331:0:21387:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783138168.525332:0:21387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783138168.525336:0:21387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783138168.525346:0:21387:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff955784068380 x1869755333181824/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783138183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783138168.525357:0:21387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783138168.525359:0:21387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1783138168.525458:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15773131-7634-4f0a-907b-e53392c960ab:3644:1869755333181824:0@lo:250:kworker.0 10000000:01000000:2.0:1783138168.525486:0:21387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783138168.525495:0:21387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97216 00000020:00000080:2.0:1783138168.525501:0:21387:0:(genops.c:906:class_export_put()) final put ffff955784298000/15773131-7634-4f0a-907b-e53392c960ab 00000020:01000000:2.0:1783138168.525811:0:21387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.106@tcp (flags='') 00000020:00000080:2.0:1783138168.525818:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138168.525823:0:21387:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783138168.525827:0:21387:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff955783a13380) has no exports 00000020:00000080:0.0:1783138168.525842:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955782aa3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783138168.525858:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955784298000/15773131-7634-4f0a-907b-e53392c960ab for MGC192.168.201.106@tcp 10000000:01000000:1.0:1783138168.525903:0:17209:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1783138168.526000:0:21387:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.106@tcp: client import never connected 00000100:00080000:2.0:1783138168.526009:0:21387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1783138168.526012:0:21387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783138168.526015:0:21387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1783138168.526017:0:21387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783138168.526058:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9558bfb1b800 for MGC192.168.201.106@tcp 00000020:00000080:2.0:1783138168.526069:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138168.526075:0:21387:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.106@tcp (uuid 15773131-7634-4f0a-907b-e53392c960ab) 00000020:00000080:2.0:1783138168.526079:0:21387:0:(genops.c:906:class_export_put()) final put ffff9558bfb1d000/15773131-7634-4f0a-907b-e53392c960ab 00000020:00000080:2.0:1783138168.526081:0:21387:0:(genops.c:865:class_export_destroy()) destroying export ffff9558bfb1d000/15773131-7634-4f0a-907b-e53392c960ab for MGC192.168.201.106@tcp 00000020:01000000:2.0:1783138168.526086:0:21387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.106@tcp (15773131-7634-4f0a-907b-e53392c960ab) 00000020:01000000:2.0:1783138168.526357:0:21387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783138168.526362:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138168.526366:0:21387:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783138168.526371:0:21387:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff955781f4e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783138168.526376:0:21387:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff955781f40000) has exports, disconnecting them 00000020:00080000:2.0:1783138168.526379:0:21387:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff955781f4e000), last request at 1783138106 00000020:00000080:2.0:1783138168.526383:0:21387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e9761b 00000020:00080000:2.0:1783138168.526395:0:21387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff955781f4e000): rc 0 00000020:00000080:2.0:1783138168.526398:0:21387:0:(genops.c:906:class_export_put()) final put ffff955781f4e000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783138168.526565:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955781f4e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1783138168.528802:0:21387:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783138168.528814:0:21387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783138168.528820:0:21387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783138168.528855:0:21387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783138168.528913:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955781f4b000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783138168.529223:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138168.529243:0:21387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1783138168.529248:0:21387:0:(genops.c:906:class_export_put()) final put ffff95578343e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1783138168.529251:0:21387:0:(genops.c:865:class_export_destroy()) destroying export ffff95578343e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1783138168.529257:0:21387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1783138168.529317:0:21387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783138168.529322:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138168.529326:0:21387:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783138168.529333:0:21387:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff955782aa3800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783138168.529345:0:21387:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9558a6130000) has exports, disconnecting them 00000020:00080000:0.0:1783138168.529350:0:21387:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff955782aa3800), last request at 1783138106 00000020:00000080:0.0:1783138168.529385:0:21387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e97630 00000020:00080000:0.0:1783138168.529408:0:21387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff955782aa3800): rc 0 00000020:00000080:0.0:1783138168.529444:0:21387:0:(genops.c:906:class_export_put()) final put ffff955782aa3800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1783138168.530252:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff955782aa3800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1783138168.541771:0:21387:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1783138168.541784:0:21387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783138168.541791:0:21387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783138168.541801:0:21387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783138168.541850:0:12391:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff955782aa7000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1783138168.543714:0:19434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1783138168.564040:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1783138168.564128:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1783138168.564259:0:17196:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff955882cc1400:17196] 1 exiting: rc = 0 00000100:00100000:1.0:1783138168.573791:0:17195:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff955882cc0a00:17195] 0 exiting: rc = 1 00000100:00100000:2.0:1783138168.574014:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574324:0:17199:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff955882cc0800:17199] 2 exiting: rc = 0 00000100:00100000:1.0:1783138168.574498:0:20697:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9558b6cb0c00:20697] 3 exiting: rc = 0 00000100:00100000:1.0:1783138168.574586:0:17198:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff955882cc1200:17198] 1 exiting: rc = 0 00000100:00100000:1.0:1783138168.574668:0:17197:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9557828d3400:17197] 0 exiting: rc = 1 00000100:00100000:2.0:1783138168.574741:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574749:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574755:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574760:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574767:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574774:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574778:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574784:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574789:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574794:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574927:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574932:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574938:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574944:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574949:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574955:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574961:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574967:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574972:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574977:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574983:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574988:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574993:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.574998:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575003:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575008:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575013:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575017:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575022:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575026:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575031:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575035:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575040:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575045:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575050:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575054:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575059:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575064:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575069:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575073:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575098:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575104:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575109:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575115:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575120:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575132:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575137:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575146:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575152:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575241:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575248:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575254:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575259:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575264:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575269:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575274:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575279:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575285:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575290:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575295:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575300:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575306:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575325:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.575330:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783138168.576438:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138168.576450:0:21387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1783138168.576455:0:21387:0:(genops.c:906:class_export_put()) final put ffff955782aa4000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1783138168.576460:0:21387:0:(genops.c:865:class_export_destroy()) destroying export ffff955782aa4000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1783138168.576465:0:21387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1783138168.576525:0:21387:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9557825f9800 1 00000020:00000080:2.0:1783138168.576532:0:21387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6bc248e9a4e975d5 00000020:00000080:2.0:1783138168.576539:0:21387:0:(genops.c:906:class_export_put()) final put ffff9558b17f9000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783138168.576555:0:21387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783138168.576559:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138168.576564:0:21387:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783138168.576567:0:21387:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff955783430000) has no exports 00000020:00000080:1.0:1783138168.577988:0:12391:0:(genops.c:865:class_export_destroy()) destroying export ffff9558b17f9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1783138168.627300:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138168.627314:0:21387:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1783138168.627319:0:21387:0:(genops.c:906:class_export_put()) final put ffff9557825fd800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1783138168.627324:0:21387:0:(genops.c:865:class_export_destroy()) destroying export ffff9557825fd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1783138168.627336:0:21387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1783138168.627688:0:21387:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9557825fa800 00000020:01000000:3.0:1783138168.627709:0:21387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1783138168.627713:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138168.627718:0:21387:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783138168.627722:0:21387:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9558b71a19c0) has no exports 00000020:00000080:3.0:1783138168.627743:0:21387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138168.627747:0:21387:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1783138168.627759:0:21387:0:(genops.c:906:class_export_put()) final put ffff9557828cd000/OSS_uuid 00000020:00000080:3.0:1783138168.627761:0:21387:0:(genops.c:865:class_export_destroy()) destroying export ffff9557828cd000/OSS_uuid for OSS 00000020:01000000:3.0:1783138168.627765:0:21387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1783138168.628023:0:19281:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff95589370c600:19281] 3 exiting: rc = 0 00000100:00100000:2.0:1783138168.628135:0:18718:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9558b7317c00:18718] 1 exiting: rc = 0 00000100:00080000:1.0:1783138168.628503:0:17208:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783138168.628615:0:18717:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9558b6d4f400:18717] 0 exiting: rc = 1 00000100:00100000:1.0:1783138168.628791:0:18719:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9558b6d4ec00:18719] 2 exiting: rc = 0 00000100:00100000:3.0:1783138168.629144:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629153:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629167:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629172:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629179:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629184:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629189:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629194:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629199:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629204:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629209:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629215:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629220:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629226:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629231:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629236:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629242:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629247:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629253:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629259:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629264:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629269:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629274:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629278:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629284:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629289:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629294:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629299:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629304:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629310:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629315:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629320:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629336:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629341:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629347:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629353:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629358:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629364:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629369:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629374:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629379:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629385:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629390:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629395:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629400:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629405:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629410:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629415:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629420:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629424:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629429:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629436:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629441:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629446:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629451:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629456:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629461:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629466:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629471:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629479:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629486:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629491:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629496:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.629501:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.630944:0:18720:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff95588362ec00:18720] 0 exiting: rc = 1 00000100:00100000:1.0:1783138168.631098:0:18721:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff95588362f000:18721] 1 exiting: rc = 0 00000100:00100000:3.0:1783138168.631370:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631381:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631389:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631408:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631413:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631418:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631422:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631426:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631430:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631435:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631440:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631445:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631458:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631464:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631468:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631473:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631477:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631482:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631486:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631490:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631495:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631500:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631506:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631510:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631528:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631533:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631538:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631542:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631547:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631552:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631556:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631561:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631565:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631569:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631574:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631578:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631583:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631587:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631599:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631604:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631608:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631612:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631616:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631625:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.631974:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632041:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632049:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632059:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632067:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632072:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632077:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632082:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632088:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632093:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632098:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632104:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632109:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632114:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632119:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632124:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632130:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632134:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632139:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.632151:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.633658:0:18723:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff95588362e800:18723] 1 exiting: rc = 0 00000100:00100000:1.0:1783138168.635479:0:18722:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95588362ea00:18722] 0 exiting: rc = 1 00000100:00100000:0.0:1783138168.635705:0:20352:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff955783a19400:20352] 3 exiting: rc = 0 00000100:00100000:0.0:1783138168.635997:0:18724:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff955884850c00:18724] 2 exiting: rc = 0 00000100:00100000:3.0:1783138168.636334:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636342:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636347:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636353:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636359:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636365:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636384:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636390:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636395:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636410:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636415:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636420:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636425:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636431:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636437:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636442:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636446:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636452:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636457:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636462:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636468:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636473:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636478:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636483:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636489:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636494:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636499:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636504:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636510:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636527:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636546:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636553:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636559:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636565:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636570:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636575:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636581:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636587:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636592:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636598:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636603:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636609:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636615:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636621:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636664:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636669:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636675:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636681:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636686:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636691:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636696:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636702:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636707:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636713:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636718:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636731:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636749:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636754:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636760:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636765:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636771:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636776:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636781:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.636787:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138168.645733:0:18725:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95588362e400:18725] 0 exiting: rc = 1 00000100:00100000:2.0:1783138168.645885:0:18726:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff95588362f400:18726] 1 exiting: rc = 0 00000100:00100000:3.0:1783138168.646036:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646042:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646052:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646058:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646064:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646068:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646073:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646079:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646084:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646089:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646095:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646101:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646107:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646112:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646118:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646138:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646143:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646148:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646153:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646265:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646273:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646278:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646283:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646288:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646294:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646299:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646304:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646310:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646314:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646319:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646324:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646329:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646334:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646339:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646343:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646348:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646353:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646358:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646363:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646368:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646372:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646376:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646381:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646385:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646390:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646395:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646400:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646405:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646411:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646416:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646428:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646433:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646438:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646443:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646448:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646453:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646459:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646464:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646469:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646475:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646479:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646484:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646488:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.646494:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138168.647345:0:18728:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff95588362fe00:18728] 1 exiting: rc = 0 00000100:00100000:2.0:1783138168.647486:0:18727:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9558b9513e00:18727] 0 exiting: rc = 1 00000100:00100000:3.0:1783138168.647589:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647595:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647601:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647608:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647614:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647621:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647665:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647673:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647698:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647706:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647711:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647717:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647723:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647729:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647735:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647739:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647745:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647750:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647755:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647761:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647780:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647795:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647909:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647916:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647923:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647929:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647934:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647940:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647946:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647951:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647957:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.647963:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648045:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648053:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648058:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648065:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648072:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648078:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648084:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648090:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648096:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648101:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648107:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648114:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648135:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648143:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648148:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648153:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648233:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648243:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648255:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648262:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648268:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648274:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648279:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648285:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648299:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648305:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648311:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648329:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648336:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648342:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648348:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138168.648361:0:21387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1783138168.661193:0:21387:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783138189.128189:0:22151:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783138199.438126:0:22751:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783138199.438133:0:22751:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783138199.438134:0:22751:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783138199.438245:0:22751:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9558b1cfd000 00000020:01000004:0.0:1783138199.438262:0:22751:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783138199.438270:0:22751:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783138199.438284:0:22751:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9557834319c0) 00000020:00000080:0.0:1783138199.438299:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783138199.506151:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783138199.507464:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.509660:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.510076:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.510315:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.510654:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.511061:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.511350:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.511685:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.512069:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.512453:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.512917:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.513163:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.513347:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.513783:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.514200:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.514389:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.515084:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.515287:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.515606:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.516115:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.516307:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.516680:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.517106:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.517308:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.517668:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.518076:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.518341:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.518718:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.519162:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.519371:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.519893:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783138199.520178:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.520365:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783138199.522412:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.522917:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.523290:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783138199.523887:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783138199.524258:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783138199.524585:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.525177:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.525362:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783138199.525604:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.526074:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783138199.526264:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783138199.526660:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.527422:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.531272:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.531933:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.532259:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783138199.532943:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783138199.533590:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783138199.534089:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1783138199.534811:0:22751:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783138199.535658:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783138199.535671:0:22751:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783138199.535684:0:22751:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6bc248e9a4e97a82 00000020:01000004:2.0:1783138199.535692:0:22751:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783138199.535698:0:22751:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783138199.535703:0:22751:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9558b1cfd000 from MGS 00000020:01000004:2.0:1783138199.535706:0:22751:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783138199.535852:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9558b5d23380) 00000020:00000080:2.0:1783138199.535869:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783138199.535959:0:22751:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9558b1cfd000 from MGS, refs=2 00080000:01000000:2.0:1783138199.535964:0:22751:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783138199.535969:0:22751:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6bc248e9a4e97a90 00000100:00100000:2.0:1783138199.536330:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783138199.536461:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783138199.536477:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783138199.537943:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783138199.537952:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783138199.539132:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138199.539316:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783138199.539322:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783138199.543179:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783138199.543214:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783138199.543622:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783138199.543662:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783138199.544307:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138199.544311:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138199.544313:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138199.544564:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138199.544566:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138199.544567:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138199.545290:0:22751:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783138199.547000:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783138199.554289:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783138199.555385:0:22763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783138199.555429:0:22751:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783138199.555489:0:22751:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783138199.556518:0:22751:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783138199.556883:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138199.557179:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783138199.557185:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783138199.557899:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783138199.557905:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783138199.558274:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783138199.558281:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1783138199.559080:0:22767:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1783138199.559241:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783138199.559263:0:22751:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.106@tcp' 00000020:01000004:3.0:1783138199.559265:0:22751:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783138199.559293:0:22751:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.106@tcp (typ=mgc) 00000020:00000080:3.0:1783138199.559305:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.106@tcp (ffff9558a6133380) 00000020:00000080:3.0:1783138199.559322:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783138199.559410:0:22751:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9558c1e92000@MGC192.168.201.106@tcp: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783138199.559553:0:22751:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.106@tcp-0 is initialized 00000040:01000000:3.0:1783138199.559559:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 1 is initialized 10000000:01000000:3.0:1783138199.560240:0:22768:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783138199.560321:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.106@tcp (uuid b284ceb2-ce2c-470b-94d2-4ecc5b43a384) 00000020:00000080:2.0:1783138199.560338:0:22751:0:(genops.c:1406:class_connect()) connect: client b284ceb2-ce2c-470b-94d2-4ecc5b43a384, cookie 0x6bc248e9a4e97a9e 00000100:00080000:2.0:1783138199.560348:0:22751:0:(import.c:512:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783138199.560353:0:22751:0:(import.c:626:import_select_connection()) MGC192.168.201.106@tcp: import ffff9558c1e92000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138199.560386:0:22751:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578406a300 x1869755333181952/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138199.560458:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3644:1869755333181952:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783138199.560523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783138199.560573:0:22751:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import b284ceb2-ce2c-470b-94d2-4ecc5b43a384->MGS 00000020:01000004:2.0:1783138199.560593:0:22751:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783138199.560598:0:22751:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783138199.560608:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9558b5d24d40) 00000020:00000080:2.0:1783138199.560620:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783138199.565212:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333181952 00000100:00100000:3.0:1783138199.565227:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333181952 00000100:00100000:3.0:1783138199.565280:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138199.565288:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6953850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1869755333181952:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783138199.565316:0:22764:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from b284ceb2-ce2c-470b-94d2-4ecc5b43a384@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:3.0:1783138199.565351:0:22764:0:(genops.c:1406:class_connect()) connect: client b284ceb2-ce2c-470b-94d2-4ecc5b43a384, cookie 0x6bc248e9a4e97aac 00000100:00080000:3.0:1783138199.565483:0:22764:0:(import.c:65:import_set_state_nolock()) ffff9558c1e97000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138199.565575:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6953850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+5:3644:x1869755333181952:12345-0@lo:250:mount.lustre.0 Request processed in 287us (5051us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.565583:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138199.565668:0:3644:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783138199.565677:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.106@tcp: connect to target with instance 0 00000100:00080000:3.0:1783138199.565685:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783138199.565689:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783138199.565693:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1e92000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783138199.565695:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783138199.565705:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783138199.565711:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3644:1869755333181952:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783138199.573472:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138199.574736:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783138199.574744:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783138199.575568:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783138199.575576:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783138199.578430:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783138199.578444:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1783138199.582384:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138199.582577:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1783138199.582584:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783138199.583496:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783138199.583506:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783138199.616141:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138199.616317:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783138199.616323:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783138199.617374:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783138199.617382:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783138199.618197:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138199.618336:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783138199.618342:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783138199.618991:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783138199.618998:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783138199.619549:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138199.619890:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783138199.619897:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783138199.620496:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783138199.620503:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783138199.621307:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138199.621464:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783138199.621469:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783138199.622188:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783138199.622196:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783138199.638269:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138199.638485:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783138199.638492:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783138199.639966:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783138199.640042:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783138199.640735:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783138199.640743:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783138199.641893:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783138199.641923:0:22751:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783138199.641929:0:22751:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783138199.642118:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783138199.642151:0:22751:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783138199.642156:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783138199.642158:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783138199.642159:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138199.642161:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138199.642162:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138199.642164:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138199.642165:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783138199.642166:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783138199.642168:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138199.642169:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138199.642172:0:22751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783138199.642174:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138199.642175:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783138199.642176:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138199.642177:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138199.642178:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138199.642179:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138199.642180:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783138199.642181:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783138199.642182:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138199.642183:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138199.642217:0:22751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783138199.642237:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182080:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138199.642305:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138199.642387:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1f88480 going to sleep for 11 seconds 00000100:00100000:0.0:1783138199.642437:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333182080 00000100:00100000:0.0:1783138199.642446:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333182080 00000100:00100000:0.0:1783138199.642551:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783138199.642569:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6951450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+5:22751:x1869755333182080:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783138199.642615:0:22766:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783138199.642619:0:22766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783138199.642622:0:22766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1783138199.643133:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783138199.643592:0:22766:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1783138199.645132:0:22788:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783138199.645138:0:22788:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783138199.645141:0:22788:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783138199.645144:0:22788:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783138199.645312:0:22788:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783138199.645532:0:22766:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783138199.645542:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783138199.651550:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6951450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+5:22751:x1869755333182080:12345-0@lo:253:mount.lustre.0 Request processed in 8974us (9235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.651579:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138199.651901:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783138199.651918:0:22751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783138199.651937:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783138199.651938:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783138199.651940:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138199.651941:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138199.651943:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138199.651944:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138199.651945:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783138199.651947:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783138199.651949:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138199.651950:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783138199.651990:0:22751:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9558b1cfd000 from lustre-MDT0000 10000000:01000000:3.0:1783138199.652026:0:22751:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783138199.652029:0:22751:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783138199.652033:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9558a6133380 10000000:01000000:3.0:1783138199.652036:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783138199.652045:0:22751:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9558a6133380 from 1 10000000:01000000:3.0:1783138199.652048:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783138199.652089:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138199.652101:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138199.652111:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138199.652132:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138199.652173:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138199.652213:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b94fcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.652334:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333182208 00000100:00100000:2.0:1783138199.652341:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333182208 00000100:00100000:2.0:1783138199.652383:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138199.652391:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6952450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+5:22751:x1869755333182208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138199.652406:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138199.652420:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa3400/0x6bc248e9a4e97aba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97ab3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.652452:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa3400/0x6bc248e9a4e97aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ab3 expref: 6 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.652461:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa3400/0x6bc248e9a4e97aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ab3 expref: 6 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.652470:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa3400, rc 0) 00000100:00100000:2.0:1783138199.652510:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6952450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+6:22751:x1869755333182208:12345-0@lo:101:mount.lustre.0 Request processed in 119us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.652516:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138199.652595:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138199.652608:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.652617:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.652687:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138199.652723:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.652745:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955783407300 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.652807:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333182336 00000100:00100000:2.0:1783138199.652811:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333182336 00000100:00100000:2.0:1783138199.652833:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138199.652838:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6952850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+6:22751:x1869755333182336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138199.652912:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6952850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+6:22751:x1869755333182336:12345-0@lo:501:mount.lustre.0 Request processed in 72us (187us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783138199.652924:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138199.653137:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182336:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783138199.653167:0:22751:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783138199.653186:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.653196:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138199.653203:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9558b1cfd000 10000000:01000000:1.0:1783138199.653207:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783138199.653211:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9558b1cfd000 10000000:01000000:1.0:1783138199.653213:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783138199.653216:0:22751:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9558b1cfd000 from 1 10000000:01000000:1.0:1783138199.653219:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783138199.653236:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302bc00/0x6bc248e9a4e97ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.653244:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302bc00/0x6bc248e9a4e97ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.653251:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302bc00/0x6bc248e9a4e97ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.653263:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138199.653289:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.653308:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955783407300 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.653514:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333182464 00000100:00100000:2.0:1783138199.653519:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333182464 00000100:00100000:2.0:1783138199.653542:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138199.653550:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+6:22751:x1869755333182464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138199.653557:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138199.653567:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa3c00/0x6bc248e9a4e97ac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97ac1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.653582:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa3c00/0x6bc248e9a4e97ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ac1 expref: 7 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.653591:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa3c00/0x6bc248e9a4e97ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ac1 expref: 7 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.653598:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa3c00, rc 0) 00000100:00100000:2.0:1783138199.653654:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+7:22751:x1869755333182464:12345-0@lo:101:mount.lustre.0 Request processed in 105us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.653661:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138199.653732:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138199.653749:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302bc00/0x6bc248e9a4e97ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ac8 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.653757:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302bc00/0x6bc248e9a4e97ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97ac8 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138199.653769:0:22751:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783138199.653792:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302bc00/0x6bc248e9a4e97ac1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ac8 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.653799:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302bc00/0x6bc248e9a4e97ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ac8 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138199.653805:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783138199.653809:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138199.653812:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9558b1cfd000 10000000:01000000:1.0:1783138199.653815:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783138199.653817:0:22751:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783138199.653819:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783138199.653831:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b600/0x6bc248e9a4e97acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.653839:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302b600/0x6bc248e9a4e97acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.653846:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302b600/0x6bc248e9a4e97acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.653858:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138199.653893:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.653910:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955783407300 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.654084:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333182592 00000100:00100000:2.0:1783138199.654088:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333182592 00000100:00100000:2.0:1783138199.654111:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138199.654118:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+7:22751:x1869755333182592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138199.654125:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138199.654132:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa3a00/0x6bc248e9a4e97ad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97acf expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.654146:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa3a00/0x6bc248e9a4e97ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97acf expref: 8 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.654162:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa3a00/0x6bc248e9a4e97ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97acf expref: 8 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.654169:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa3a00, rc 0) 00000100:00100000:2.0:1783138199.654204:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+8:22751:x1869755333182592:12345-0@lo:101:mount.lustre.0 Request processed in 87us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.654210:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783138199.654325:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138199.654337:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302b600/0x6bc248e9a4e97acf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ad6 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.654345:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302b600/0x6bc248e9a4e97acf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97ad6 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.654386:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138199.654412:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.654432:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955783407300 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.654526:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333182720 00000100:00100000:2.0:1783138199.654531:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333182720 00000100:00100000:2.0:1783138199.654562:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138199.654568:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+8:22751:x1869755333182720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138199.654707:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+9:22751:x1869755333182720:12345-0@lo:501:mount.lustre.0 Request processed in 138us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.654714:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783138199.654900:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138199.654941:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138199.655048:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.655075:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955783407300 going to sleep for 11 seconds 00000100:00100000:3.0:1783138199.655127:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333182848 00000100:00100000:3.0:1783138199.655131:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333182848 00000100:00100000:3.0:1783138199.655153:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783138199.655161:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+9:22751:x1869755333182848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138199.655802:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+9:22751:x1869755333182848:12345-0@lo:503:mount.lustre.0 Request processed in 640us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.655810:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138199.656087:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333182848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138199.656568:0:22789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22789:1869755333182976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783138199.656615:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138199.656713:0:22789:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b94fc300 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.656909:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333182976 00000100:00100000:2.0:1783138199.656917:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333182976 00000100:00100000:2.0:1783138199.657058:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138199.657067:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+9:22789:x1869755333182976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138199.657707:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+9:22789:x1869755333182976:12345-0@lo:502:llog_process_th.0 Request processed in 639us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.657715:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138199.657831:0:22789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22789:1869755333182976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783138199.657866:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138199.657879:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138199.657881:0:22789:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783138199.657887:0:22789:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783138199.657889:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783138199.657906:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff955783434d40) 00000020:00000080:0.0:1783138199.657922:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783138199.657929:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783138199.658145:0:22789:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783138199.658152:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6bc248e9a4e97ae4 00000020:00000080:0.0:1783138199.658363:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783138199.658369:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138199.658372:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138199.658374:0:22789:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783138199.658376:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138199.658379:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138199.658381:0:22789:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783138199.658384:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783138199.658391:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff955783433380) 00000020:00000080:0.0:1783138199.658401:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783138199.658404:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783138199.658414:0:22789:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783138199.658417:0:22789:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783138199.658424:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783138199.658482:0:22789:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9558b1cfd000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783138199.658496:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff955783430000) 00000020:00000080:0.0:1783138199.658504:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783138199.658550:0:22789:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783138199.658556:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6bc248e9a4e97af9 00000020:00000080:0.0:1783138199.658727:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783138199.658733:0:22789:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783138199.658737:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6bc248e9a4e97b00 00080000:01000000:0.0:1783138199.658742:0:22789:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783138199.658745:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6bc248e9a4e97b07 00010000:00010000:3.0:1783138199.746969:0:22789:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1783138199.747548:0:22789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1783138199.748117:0:22789:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783138199.748695:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9558a6134d40) 00000020:00000080:3.0:1783138199.748713:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783138199.748789:0:22789:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783138199.748797:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6bc248e9a4e97b15 00000020:00000080:2.0:1783138199.755289:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783138199.759424:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6bc248e9a4e97b1c 00000020:00000080:3.0:1783138199.759926:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783138199.759940:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138199.759947:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138199.759949:0:22789:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783138199.759953:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783138199.759956:0:22789:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783138199.759958:0:22789:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138199.759959:0:22789:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138199.759961:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783138199.759964:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138199.759965:0:22789:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783138199.759968:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138199.759981:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138199.759983:0:22789:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783138199.759988:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783138199.760029:0:22789:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783138199.760048:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138199.760058:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138199.760059:0:22789:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783138199.760063:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138199.760067:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138199.760068:0:22789:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783138199.760072:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783138199.760077:0:22789:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:00000080:3.0:1783138199.760105:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783138199.760122:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9558a6130000) 00000020:00000080:3.0:1783138199.760136:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783138199.760142:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783138199.760194:0:22789:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783138199.760199:0:22789:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783138199.760204:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6bc248e9a4e97b2a 00010000:00080000:3.0:1783138199.760236:0:22789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95578431a800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783138199.761917:0:22789:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1783138199.769852:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783138199.769869:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783138199.769911:0:22789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783138199.769931:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6bc248e9a4e97b31 00000100:00080000:3.0:1783138199.769941:0:22789:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138199.769947:0:22789:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95578431a800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138199.770015:0:22789:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558ace4b100 x1869755333183104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138199.770039:0:22789:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783138199.770118:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138199.770123:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138199.770125:0:22789:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783138199.770129:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783138199.770133:0:22789:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783138199.770134:0:22789:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138199.770148:0:22789:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138199.770150:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783138199.770152:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138199.770153:0:22789:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783138199.770156:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783138199.770161:0:22789:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783138199.770164:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138199.770165:0:22789:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783138199.770168:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783138199.770172:0:22789:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1783138199.770273:0:22789:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783138199.770277:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783138199.770289:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9558a61319c0) 00000020:00000080:3.0:1783138199.770301:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1783138199.770306:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783138199.770365:0:22789:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783138199.770371:0:22789:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783138199.770376:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6bc248e9a4e97b3f 00010000:00080000:3.0:1783138199.770406:0:22789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95578266b800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783138199.770610:0:22789:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1783138199.770965:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333183104:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783138199.771039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138199.771134:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333183104 00000100:00100000:0.0:1783138199.771142:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333183104 00000100:00100000:0.0:1783138199.771187:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138199.771196:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869755333183104:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1783138199.771212:0:22776:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1783138199.773546:0:22789:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783138199.774314:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783138199.781078:0:22789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138199.781342:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1783138199.786964:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1783138199.790419:0:22795:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783138199.790426:0:22795:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783138199.792624:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783138199.792681:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783138199.792736:0:22789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783138199.792758:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6bc248e9a4e97b46 00000100:00080000:2.0:1783138199.792769:0:22789:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783138199.792776:0:22789:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95578266b800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138199.792812:0:22789:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955784069180 x1869755333183232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138199.792832:0:22789:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783138199.793021:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333183232:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783138199.793081:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333183232 offset 0 length 520: 4 00000020:01000000:2.0:1783138199.793591:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138199.793596:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.793598:0:22789:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783138199.793601:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783138199.793603:0:22789:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1783138199.793605:0:22789:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783138199.793606:0:22789:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783138199.793608:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783138199.793610:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.793612:0:22789:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783138199.793615:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783138199.793619:0:22789:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783138199.793622:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.793623:0:22789:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783138199.793626:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783138199.793649:0:22789:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:2.0:1783138199.793671:0:22789:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783138199.793674:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138199.793687:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9558b5d219c0) 00000020:00000080:2.0:1783138199.793700:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1783138199.793705:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783138199.793781:0:22789:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783138199.793787:0:22789:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783138199.793794:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6bc248e9a4e97b54 00010000:00080000:2.0:1783138199.793823:0:22789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9558b1ced800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1783138199.794069:0:22789:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1783138199.794140:0:22789:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783138199.794165:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783138199.800580:0:22789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783138199.801064:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1783138199.801239:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1783138199.801786:0:22797:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783138199.801790:0:22797:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783138199.803076:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783138199.803092:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783138199.803134:0:22789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783138199.803417:0:22789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6bc248e9a4e97b5b 00000100:00080000:2.0:1783138199.803430:0:22789:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783138199.803517:0:22789:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9558b1ced800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138199.803558:0:22789:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955784069f80 x1869755333183360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138199.803588:0:22789:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783138199.803658:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138199.803663:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.803665:0:22789:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783138199.803668:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138199.803671:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.803673:0:22789:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783138199.803676:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783138199.803678:0:22789:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783138199.803680:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138199.803682:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.803684:0:22789:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783138199.803686:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138199.803689:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.803690:0:22789:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783138199.803705:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783138199.803741:0:22789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22789:1869755333183488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138199.803818:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138199.803869:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333183488 00000100:00100000:2.0:1783138199.803876:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333183488 00000100:00100000:2.0:1783138199.803913:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138199.803921:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+9:22789:x1869755333183488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783138199.804029:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333183360:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783138199.804048:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+9:22789:x1869755333183488:12345-0@lo:502:llog_process_th.0 Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.804057:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000400:00000100:1.0:1783138199.804073:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333183360 offset 0 length 520: 4 00000100:00100000:2.0:1783138199.804107:0:22789:0:(client.c:2701:ptlrpc_set_wait()) set ffff95578297db40 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.804131:0:22789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22789:1869755333183488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783138199.804167:0:22789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138199.804172:0:22789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.804173:0:22789:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783138199.804177:0:22789:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1783138199.804263:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783138199.804291:0:22751:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783138199.804311:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b600/0x6bc248e9a4e97acf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ad6 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.804323:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302b600/0x6bc248e9a4e97acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ad6 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138199.804332:0:22751:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9558b1cfd000 from 1 10000000:01000000:1.0:1783138199.804335:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783138199.804362:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.804370:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.804379:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.804393:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333183616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138199.804420:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.804440:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955783407f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.804573:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333183616 00000100:00100000:2.0:1783138199.804578:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333183616 00000100:00100000:2.0:1783138199.804603:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138199.804609:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+9:22751:x1869755333183616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138199.804618:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138199.804660:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97b62 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.804681:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 10 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.804692:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 10 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.804708:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2a00, rc 0) 00000100:00100000:2.0:1783138199.804736:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+10:22751:x1869755333183616:12345-0@lo:101:mount.lustre.0 Request processed in 127us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.804743:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783138199.805030:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333183616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138199.805044:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.805054:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.805695:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333183744:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783138199.805746:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.805782:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955783407f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138199.805839:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869755333183104:12345-0@lo:38:llog_process_th.0 Request processed in 34642us (34799us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783138199.805852:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333183744 00000100:00100000:1.0:1783138199.805856:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138199.805860:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333183744 00000100:00100000:3.0:1783138199.805901:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1783138199.805901:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138199.805910:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783138199.805914:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+10:22751:x1869755333183744:12345-0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783138199.805918:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333183104:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1783138199.805933:0:22764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783138199.805943:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1783138199.806271:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+10:22751:x1869755333183744:12345-0@lo:256:mount.lustre.0 Request processed in 359us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.806287:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138199.806371:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333183744:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783138199.807299:0:22751:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783138199.807321:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.807332:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138199.807348:0:22751:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9558b1cfd000 from 1 10000000:01000000:2.0:1783138199.807351:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138199.807386:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.807395:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.807404:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138199.807423:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333183872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138199.807525:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138199.807557:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff95578297d480 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.807582:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333183872 00000100:00100000:2.0:1783138199.807596:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333183872 00000100:00100000:2.0:1783138199.807656:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783138199.807664:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+10:22751:x1869755333183872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138199.807675:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138199.807688:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97b70 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.807709:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 11 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.807719:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 11 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.807726:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2200, rc 0) 00000100:00100000:2.0:1783138199.807758:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22751:x1869755333183872:12345-0@lo:101:mount.lustre.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.807765:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783138199.807807:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333183872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138199.807820:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138199.807829:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138199.808222:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138199.808252:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138199.808278:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff95578297d480 going to sleep for 11 seconds 00000100:00100000:3.0:1783138199.808320:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333184000 00000100:00100000:3.0:1783138199.808325:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333184000 00000100:00100000:3.0:1783138199.808363:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783138199.808370:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22751:x1869755333184000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138199.808682:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22751:x1869755333184000:12345-0@lo:501:mount.lustre.0 Request processed in 312us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.808689:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138199.809028:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138199.809064:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138199.809114:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.809148:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955783407480 going to sleep for 11 seconds 00000100:00100000:3.0:1783138199.809214:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333184128 00000100:00100000:3.0:1783138199.809221:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333184128 00000100:00100000:3.0:1783138199.809257:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783138199.809264:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22751:x1869755333184128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138199.809352:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22751:x1869755333184128:12345-0@lo:503:mount.lustre.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.809359:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783138199.809437:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138199.810059:0:22799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22799:1869755333184256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138199.810108:0:22799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138199.810143:0:22799:0:(client.c:2701:ptlrpc_set_wait()) set ffff95578297df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138199.810278:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333184256 00000100:00100000:3.0:1783138199.810284:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333184256 00000100:00100000:3.0:1783138199.810313:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783138199.810320:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22799:x1869755333184256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783138199.811154:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22799:x1869755333184256:12345-0@lo:502:llog_process_th.0 Request processed in 829us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.811163:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138199.811440:0:22799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22799:1869755333184256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783138199.811757:0:22799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138199.811767:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.811769:0:22799:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783138199.811777:0:22799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9558b1cfd000 00000020:00000080:2.0:1783138199.811780:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783138199.811787:0:22799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138199.811790:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.811791:0:22799:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783138199.811793:0:22799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138199.811796:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.811797:0:22799:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783138199.811800:0:22799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9558b1cfd000 00000020:00000080:2.0:1783138199.811802:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783138199.812243:0:22799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138199.812248:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.812249:0:22799:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783138199.812252:0:22799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138199.812254:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.812255:0:22799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783138199.812259:0:22799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9558b1cfd000 00000020:00000080:2.0:1783138199.812261:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783138199.812284:0:22799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138199.812286:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.812288:0:22799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783138199.812290:0:22799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138199.812292:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.812294:0:22799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783138199.812297:0:22799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9558b1cfd000 00000020:00000080:2.0:1783138199.812299:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783138199.812946:0:22799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22799:1869755333184384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138199.818312:0:22799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138199.819076:0:22799:0:(client.c:2701:ptlrpc_set_wait()) set ffff95578297df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138199.820339:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333184384 00000100:00100000:3.0:1783138199.820351:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333184384 00000100:00100000:3.0:1783138199.820407:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783138199.820417:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22799:x1869755333184384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783138199.820584:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22799:x1869755333184384:12345-0@lo:502:llog_process_th.0 Request processed in 168us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.820592:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783138199.821279:0:22799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22799:1869755333184384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783138199.821318:0:22799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138199.821325:0:22799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138199.821328:0:22799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783138199.821332:0:22799:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783138199.823946:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783138199.825667:0:22751:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783138199.825704:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138199.825718:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138199.825779:0:22751:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783138199.825783:0:22751:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9558b1cfd000 10000000:01000000:0.0:1783138199.825786:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9558b1cfd000 10000000:01000000:0.0:1783138199.825791:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783138199.825798:0:22751:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9558b1cfd000 from 1 10000000:01000000:0.0:1783138199.825808:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783138199.825852:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834dec00/0x6bc248e9a4e97b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138199.825861:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9557834dec00/0x6bc248e9a4e97b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138199.825872:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9557834dec00/0x6bc248e9a4e97b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138199.825898:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783138199.825967:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138199.828123:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333184512 00000100:00100000:3.0:1783138199.828135:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333184512 00000100:00100000:0.0:1783138199.828146:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1783138199.828294:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783138199.828306:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22751:x1869755333184512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138199.828322:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138199.828341:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b7025e00/0x6bc248e9a4e97b85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97b7e expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138199.828371:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b7025e00/0x6bc248e9a4e97b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97b7e expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138199.828386:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b7025e00/0x6bc248e9a4e97b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97b7e expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138199.828395:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b7025e00, rc 0) 00000100:00100000:3.0:1783138199.828465:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22751:x1869755333184512:12345-0@lo:101:mount.lustre.0 Request processed in 161us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.828472:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783138199.828680:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138199.828698:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9557834dec00/0x6bc248e9a4e97b7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b85 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138199.828708:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9557834dec00/0x6bc248e9a4e97b7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97b85 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138199.828784:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138199.828820:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138199.828843:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1783138199.828847:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333184640 00000100:00100000:3.0:1783138199.828852:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333184640 00000100:00100000:3.0:1783138199.828883:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783138199.828891:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22751:x1869755333184640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138199.829029:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22751:x1869755333184640:12345-0@lo:501:mount.lustre.0 Request processed in 138us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138199.829046:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783138199.829057:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138199.829093:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138199.829133:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.829223:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138199.829243:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333184768 00000100:00100000:1.0:1783138199.829246:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333184768 00000100:00100000:1.0:1783138199.829273:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138199.829280:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22751:x1869755333184768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138199.829432:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22751:x1869755333184768:12345-0@lo:503:mount.lustre.0 Request processed in 150us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138199.830132:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138199.830277:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333184768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138199.830821:0:22803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22803:1869755333184896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783138199.830877:0:22803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138199.833218:0:22803:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d3d600 going to sleep for 11 seconds 00000100:00100000:1.0:1783138199.834861:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333184896 00000100:00100000:1.0:1783138199.834874:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333184896 00000100:00100000:1.0:1783138199.834929:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783138199.834940:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22803:x1869755333184896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783138199.835244:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22803:x1869755333184896:12345-0@lo:502:llog_process_th.0 Request processed in 305us (4365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138199.835253:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783138199.837986:0:22803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22803:1869755333184896:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783138199.838073:0:22803:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783138199.838088:0:22803:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff955781f419c0) 00000020:00000080:1.0:1783138199.838108:0:22803:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1783138199.838849:0:22803:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9558b1cfd000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783138199.838854:0:22803:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9558b1cfd000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783138199.838857:0:22803:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9558b1cfd000 4 00010000:00080000:1.0:1783138199.838888:0:22803:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9558b1cf2000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:1.0:1783138199.844536:0:22803:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1783138199.844676:0:22803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783138199.844719:0:22803:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783138199.844731:0:22803:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6bc248e9a4e97b93 00000100:00080000:1.0:1783138199.844742:0:22803:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783138199.844748:0:22803:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9558b1cf2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783138199.844783:0:22803:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558b17c4700 x1869755333185024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138199.845087:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869755333185024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783138199.845236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783138199.845305:0:22803:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783138199.846835:0:22803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22803:1869755333185152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783138199.846903:0:22803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.846943:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333185152 00000100:00100000:1.0:1783138199.846950:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333185152 00000100:00100000:1.0:1783138199.847009:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783138199.847019:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22803:x1869755333185152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783138199.847126:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22803:x1869755333185152:12345-0@lo:502:llog_process_th.0 Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138199.847135:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783138199.847386:0:22803:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138199.847411:0:22803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22803:1869755333185152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783138199.847457:0:22803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22803:1869755333185280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783138199.847489:0:22803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.847511:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333185280 00000100:00100000:1.0:1783138199.847515:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333185280 00000100:00100000:1.0:1783138199.847538:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783138199.847546:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22803:x1869755333185280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783138199.847605:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22803:x1869755333185280:12345-0@lo:502:llog_process_th.0 Request processed in 60us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138199.847613:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783138199.847683:0:22803:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138199.847695:0:22803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22803:1869755333185280:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783138199.847716:0:22803:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783138199.847775:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783138199.847795:0:22751:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783138199.847808:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9557834dec00/0x6bc248e9a4e97b7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b85 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.847819:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9557834dec00/0x6bc248e9a4e97b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97b85 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783138199.847864:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783138199.847866:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138199.847868:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138199.847870:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138199.847871:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138199.847873:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138199.847875:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138199.847877:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783138199.847879:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138199.847881:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138199.847884:0:22751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783138199.847887:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783138199.847888:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138199.847890:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138199.847891:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138199.847892:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138199.847894:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138199.847895:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138199.847897:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783138199.847898:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138199.847899:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138199.847912:0:22751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783138199.847922:0:22751:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333185408:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783138199.847954:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.847986:0:22751:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138199.848049:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333185408 00000100:00100000:2.0:1783138199.848054:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333185408 00000100:00100000:2.0:1783138199.848086:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138199.848094:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22751:x1869755333185408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783138199.848116:0:22765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783138199.848131:0:22765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783138199.848671:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333185024 00000100:00100000:0.0:1783138199.848677:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333185024 00000100:00100000:0.0:1783138199.848702:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138199.848708:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333185024:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783138199.848765:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333185024:12345-0@lo:38:llog_process_th.0 Request processed in 56us (3530us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783138199.848773:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783138199.849569:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783138199.849578:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1cf2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138199.849592:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783138199.849597:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869755333185024:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1783138199.853355:0:22765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783138199.853374:0:22765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783138199.853394:0:22787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783138199.853400:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783138199.853425:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.853452:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.853462:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.853497:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.853510:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 12 pid: 22765 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.853524:0:22787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333185536:0@lo:104: 00000100:00100000:1.0:1783138199.853582:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.853643:0:22787:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981600 going to sleep for 11 seconds 00000100:00100000:3.0:1783138199.853851:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333185536 00000100:00100000:3.0:1783138199.853859:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333185536 00000100:00100000:2.0:1783138199.854129:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22751:x1869755333185408:12345-0@lo:253:mount.lustre.0 Request processed in 6035us (6173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138199.854139:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783138199.854241:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138199.854252:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:22787:x1869755333185536:12345-0@lo:104: 00010000:00010000:3.0:1783138199.854265:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.854287:0:22751:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22751:1869755333185408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783138199.854301:0:22751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783138199.854305:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783138199.854307:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138199.854309:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138199.854310:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138199.854312:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138199.854313:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138199.854315:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00010000:00010000:3.0:1783138199.854319:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:01000004:1.0:1783138199.854325:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:3.0:1783138199.854328:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:22787:x1869755333185536:12345-0@lo:104: Request processed in 78us (745us total) trans 0 rc 0/0 00000020:01000004:1.0:1783138199.854329:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138199.854332:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783138199.854339:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:02000000:1.0:1783138199.854349:0:22751:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783138199.857738:0:22787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333185536:0@lo:104: 00010000:00010000:0.0:1783138199.857765:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.857895:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138199.857904:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.857913:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302b200 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138199.857917:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.857927:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138199.857935:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138199.857941:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783138199.862330:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862344:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138199.862367:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862375:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97b62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97b69 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862393:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138199.862396:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138199.862398:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138199.862489:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333185664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138199.862554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138199.862707:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333185664 00000100:00100000:1.0:1783138199.862715:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333185664 00010000:00010000:1.0:1783138199.862745:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 12 pid: 22765 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138199.862781:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783138199.862791:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:3648:x1869755333185664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138199.862806:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138199.862811:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 12 pid: 22765 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862824:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 12 pid: 22765 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862841:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97b69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97b62 expref: 12 pid: 22765 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862855:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862863:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783138199.862879:0:22757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009479714s 00010000:00010000:1.0:1783138199.862885:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862892:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862899:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862913:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862918:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302b400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138199.862922:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862930:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862947:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.862957:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138199.863011:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:3648:x1869755333185664:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138199.863019:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783138199.863047:0:22787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.863056:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138199.863063:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95588302b400/0x6bc248e9a4e97b9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138199.864123:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333185664:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1783138199.875271:0:22751:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1783138199.875801:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783138199.876511:0:22810:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1783138199.876516:0:22810:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1783138199.876562:0:22811:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783138199.876856:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1783138199.877457:0:22811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1783138199.879120:0:22812:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9558ace4a680 x1869755333185792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138199.879136:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000040:01000000:0.0:1783138199.879680:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783138199.879718:0:22751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783138199.881543:0:22751:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783138199.881559:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783138199.881641:0:22751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783138199.884114:0:22811:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1783138199.884233:0:22751:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00080000:2.0:1783138199.884411:0:22811:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1783138199.885704:0:22751:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783138199.885758:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783138199.887145:0:22751:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1783138199.887954:0:22751:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1783138199.890329:0:22751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1783138199.897858:0:22751:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783138199.897898:0:22751:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb79740dd3988 00100000:10000000:3.0:1783138199.897907:0:22751:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783138199.901059:0:22751:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783138199.901080:0:22751:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783138199.901102:0:22751:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1783138199.901125:0:22751:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783138199.912602:0:22751:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138199.912940:0:22751:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783138200.568284:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783138200.887568:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783138200.887576:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9558b1cfd000 from 11 10000000:01000000:3.0:1783138200.887582:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783138200.887656:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138200.887669:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138200.887681:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138200.887708:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333185920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783138200.887779:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138200.887826:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1db3780 going to sleep for 11 seconds 00000100:00100000:3.0:1783138200.887846:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000100:00100000:3.0:1783138200.896173:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333185920 00000100:00100000:3.0:1783138200.896195:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333185920 00000100:00100000:3.0:1783138200.896269:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783138200.896280:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+11:22768:x1869755333185920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138200.896300:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138200.896322:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97ba1 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138200.896356:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138200.896366:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138200.896376:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b7024800, rc 0) 00000100:00100000:3.0:1783138200.896474:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22768:x1869755333185920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (8693us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138200.896481:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783138200.896539:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333185920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138200.896557:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138200.896567:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138200.896661:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333186048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783138200.896702:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138200.896730:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1db3780 going to sleep for 11 seconds 00000100:00100000:2.0:1783138200.901532:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333186048 00000100:00100000:2.0:1783138200.901548:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333186048 00000100:00100000:2.0:1783138200.901617:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783138200.901653:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22768:x1869755333186048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138200.901681:0:22766:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138200.901704:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138200.901707:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1783138200.901838:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:22768:x1869755333186048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 212us (5135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138200.901845:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783138200.901904:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333186048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783138200.901973:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783138200.901984:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138200.901994:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138200.904525:0:22806:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783138200.904536:0:22806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783138200.924283:0:22806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783138200.924298:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1783138201.592645:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138201.908820:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000040:00080000:3.0:1783138201.978264:0:22806:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783138201.978273:0:22806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783138201.978407:0:22806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1783138201.979301:0:22806:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783138201.981553:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1783138202.617530:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138202.934213:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:0.0:1783138203.638657:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138203.957693:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000001:02000400:3.0:1783138204.513400:0:23055:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783138204.669260:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138204.982058:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000100:00080000:2.0:1783138205.300817:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783138205.300824:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783138205.300828:0:38:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138205.300836:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:2.0:1783138205.300842:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783138205.300848:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95578431a800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138205.300871:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955784068700 x1869755333186304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138205.300914:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138205.300918:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138205.300920:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138205.300923:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138205.300925:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783138205.300929:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783138205.300931:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558b1cf2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138205.300936:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9558b1cf2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138205.300950:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578406bb80 x1869755333186432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138205.300990:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333186304:0@lo:38:kworker.0 00000100:00100000:2.0:1783138205.301067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138205.301114:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869755333186432:0@lo:38:kworker.0 00000100:00100000:2.0:1783138205.301145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138205.301189:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333186304 00000100:00100000:2.0:1783138205.301197:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333186304 00000100:00100000:2.0:1783138205.301243:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138205.301250:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869755333186304:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783138205.301267:0:22777:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783138205.301304:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869755333186304:12345-0@lo:38:kworker.0 Request processed in 53us (238us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138205.301311:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783138205.301351:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138205.301361:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138205.301365:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333186304:0@lo:38:kworker.0 00000100:00100000:0.0:1783138205.301492:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138205.301501:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3646:1869755333186176:0@lo:400:kworker.0 00000100:00100000:0.0:1783138205.301534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138205.301587:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333186432 00000100:00100000:0.0:1783138205.301591:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333186432 00000100:00100000:0.0:1783138205.301612:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783138205.301616:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869755333186432:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783138205.301662:0:22773:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:0.0:1783138205.301697:0:22773:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6bc248e9a4e97baf 00000004:00100000:0.0:1783138205.301711:0:22773:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783138205.301842:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9557828cf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138205.301896:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1869755333186432:12345-0@lo:38:kworker.0 Request processed in 278us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138205.301903:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138205.302311:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333186176 00000100:00100000:2.0:1783138205.302316:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333186176 00000100:00100000:2.0:1783138205.302357:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783138205.302365:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:3646:x1869755333186176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138205.302413:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:3646:x1869755333186176:12345-0@lo:400:kworker.0 Request processed in 50us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138205.302420:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1783138205.302465:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95578406bb80 x1869755333186432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138205.302478:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783138205.302486:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783138205.302490:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783138205.302492:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1cf2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783138205.302498:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869755333186432:0@lo:38:kworker.0 00000100:00100000:0.0:1783138205.302557:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3646:1869755333186176:0@lo:400:kworker.0 00000020:00000004:0.0:1783138205.344672:0:23107:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138205.344946:0:23107:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783138205.693730:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138206.004754:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000020:00000004:2.0:1783138206.266788:0:23157:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783138206.267419:0:23157:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138206.715276:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138207.039990:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:2.0:1783138207.742682:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138208.059211:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:1.0:1783138208.756957:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138209.079076:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000100:00100000:0.0:1783138209.415299:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138199/real 1783138199] req@ffff955784069f80 x1869755333183360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138209.415334:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff955784069f80 x1869755333183360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138209.422823:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138199/real 1783138199] req@ffff955784069180 x1869755333183232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138209.422857:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff955784069180 x1869755333183232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783138209.422878:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138209.422900:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783138209.422904:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333183360:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783138209.422960:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783138209.422964:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783138209.422966:0:38:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138209.422972:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:0.0:1783138209.422977:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783138209.422992:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95578431a800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138209.423013:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2d880 x1869755333186688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138209.423024:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138209.423026:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138209.423028:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138209.423031:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783138209.423032:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138209.423035:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:0.0:1783138209.423037:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138209.423040:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9558b1ced800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138209.423049:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2f480 x1869755333186816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138209.423101:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3646:1869755333186560:0@lo:400:kworker.0 00000100:00100000:0.0:1783138209.423171:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138209.423239:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333186944:0@lo:400:kworker.0 00000100:00100000:0.0:1783138209.423267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138209.423342:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333186560 00000100:00100000:0.0:1783138209.423350:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333186560 00000100:00100000:0.0:1783138209.423396:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783138209.423406:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:3646:x1869755333186560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138209.423455:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:3646:x1869755333186560:12345-0@lo:400:kworker.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138209.423461:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1783138209.425703:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578266b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138209.425728:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783138209.425734:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333183232:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783138209.425772:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138209.425777:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783138209.425780:0:8:0:(import.c:65:import_set_state_nolock()) ffff95578266b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138209.425784:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:1.0:1783138209.425789:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783138209.425796:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95578266b800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783138209.425843:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558b17c5180 x1869755333187072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138209.425873:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333186688:0@lo:38:kworker.0 00000100:00100000:1.0:1783138209.425985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138209.426015:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333186816:0@lo:8:kworker.0 00000400:00000100:1.0:1783138209.426034:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333186816 offset 0 length 520: 4 00000100:00100000:1.0:1783138209.426055:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333187072:0@lo:8:kworker.0 00000400:00000100:1.0:1783138209.426069:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333187072 offset 0 length 520: 4 00000100:00100000:0.0:1783138209.426132:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333186944 00000100:00100000:0.0:1783138209.426140:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333186944 00000100:00100000:0.0:1783138209.426192:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138209.426202:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333186944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138209.426258:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333186944:12345-0@lo:400:kworker.0 Request processed in 58us (2990us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138209.426266:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783138209.426306:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff955889f2c700 x1869755333186944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138209.426319:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333186944:0@lo:400:kworker.0 00000100:00100000:0.0:1783138209.426345:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3646:1869755333186560:0@lo:400:kworker.0 00000100:00100000:2.0:1783138209.433791:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333186688 00000100:00100000:2.0:1783138209.433818:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333186688 00000100:00100000:2.0:1783138209.433875:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138209.433887:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869755333186688:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783138209.433914:0:22777:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783138209.434030:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869755333186688:12345-0@lo:38:kworker.0 Request processed in 144us (8043us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138209.434037:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783138209.437723:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138209.437736:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138209.437742:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333186688:0@lo:38:kworker.0 00010000:00010000:3.0:1783138209.781492:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138210.103920:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:2.0:1783138210.806354:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138211.129271:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000040:00080000:2.0:1783138211.190300:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783138211.832118:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138212.148695:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:2.0:1783138212.852808:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138213.176020:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00000020:01000004:0.0:1783138213.553940:0:23504:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783138213.553946:0:23504:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783138213.553947:0:23504:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783138213.554102:0:23504:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9557828c9000 00000020:01000004:0.0:1783138213.554119:0:23504:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1783138213.554133:0:23504:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783138213.554150:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9558b183b380) 00000020:00000080:0.0:1783138213.554168:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783138213.625189:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.627903:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783138213.633679:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783138213.634105:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1783138213.634359:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783138213.634805:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783138213.635107:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1783138213.635290:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783138213.636028:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783138213.636254:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783138213.636703:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1783138213.637248:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783138213.637757:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783138213.638031:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783138213.639122:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.639693:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.640057:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.640358:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.640872:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.641164:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.641712:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.641986:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.642177:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.643972:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.644356:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.644768:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.645090:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.645738:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.646161:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.646671:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.647045:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.647335:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.647783:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.648092:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.648284:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.648769:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.649093:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.649327:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.649874:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.650182:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.650689:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.651023:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1783138213.651245:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783138213.651994:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783138213.653390:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783138213.654564:0:23504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00080000:01000000:3.0:1783138213.656022:0:23504:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783138213.656903:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1783138213.656915:0:23504:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783138213.656928:0:23504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6bc248e9a4e97bbd 00000020:01000004:3.0:1783138213.656935:0:23504:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783138213.656957:0:23504:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783138213.656961:0:23504:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783138213.656967:0:23504:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1783138213.656995:0:23504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1783138213.656999:0:23504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1783138213.666714:0:23504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783138213.666770:0:23504:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1783138213.666835:0:23504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783138213.666838:0:23504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783138213.666839:0:23504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138213.666840:0:23504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138213.666842:0:23504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138213.666843:0:23504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138213.666844:0:23504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783138213.666846:0:23504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138213.666848:0:23504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783138213.666851:0:23504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1783138213.666854:0:23504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783138213.666855:0:23504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783138213.666857:0:23504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138213.666858:0:23504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138213.666859:0:23504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138213.666860:0:23504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138213.666861:0:23504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783138213.666862:0:23504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138213.666863:0:23504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783138213.666893:0:23504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783138213.666914:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187200:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783138213.667004:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138213.667145:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333187200 00000100:00100000:2.0:1783138213.667154:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333187200 00000100:00100000:3.0:1783138213.667311:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955893832840 going to sleep for 11 seconds 00000100:00100000:2.0:1783138213.667516:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783138213.667528:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:23504:x1869755333187200:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783138213.667566:0:22765:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783138213.667569:0:22765:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1783138213.667578:0:22765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1783138213.668424:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:23504:x1869755333187200:12345-0@lo:253:mount.lustre.0 Request processed in 895us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138213.668496:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187200:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783138213.668510:0:23504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783138213.668512:0:23504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783138213.668513:0:23504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783138213.668515:0:23504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138213.668516:0:23504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138213.668517:0:23504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138213.668518:0:23504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138213.668519:0:23504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783138213.668521:0:23504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138213.668522:0:23504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783138213.668546:0:23504:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9557828c9000 from lustre-MDT0001 10000000:01000000:3.0:1783138213.668579:0:23504:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1783138213.668582:0:23504:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783138213.668590:0:23504:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9558a6133380 local copy 00010000:00010000:3.0:1783138213.668605:0:23504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138213.668773:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138213.668822:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.668863:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883ef3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138213.669104:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333187328 00000100:00100000:1.0:1783138213.669117:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333187328 00000100:00100000:2.0:1783138213.669742:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783138213.669925:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783138213.669936:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:23504:x1869755333187328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138213.670054:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:23504:x1869755333187328:12345-0@lo:501:mount.lustre.0 Request processed in 120us (1230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783138213.670061:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783138213.670127:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187328:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783138213.670146:0:23504:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783138213.670168:0:23504:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783138213.670177:0:23504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.670202:0:23504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138213.670253:0:23504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9557828c9000 10000000:01000000:3.0:1783138213.670259:0:23504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783138213.670265:0:23504:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9558a6133380 10000000:01000000:3.0:1783138213.670268:0:23504:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783138213.670272:0:23504:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9558a6133380 from 1 10000000:01000000:3.0:1783138213.670276:0:23504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783138213.670305:0:23504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025400/0x6bc248e9a4e97bc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.670314:0:23504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b7025400/0x6bc248e9a4e97bc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.670324:0:23504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b7025400/0x6bc248e9a4e97bc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138213.670355:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138213.670832:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.671822:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883ef3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138213.671935:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333187456 00000100:00100000:0.0:1783138213.671944:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333187456 00000100:00100000:0.0:1783138213.671990:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783138213.671999:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+12:23504:x1869755333187456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138213.672015:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138213.672048:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9557834de600/0x6bc248e9a4e97bcb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97bc4 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.672096:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9557834de600/0x6bc248e9a4e97bcb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97bc4 expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.672109:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9557834de600/0x6bc248e9a4e97bcb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97bc4 expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.672119:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9557834de600, rc 0) 00000100:00100000:0.0:1783138213.672621:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+13:23504:x1869755333187456:12345-0@lo:101:mount.lustre.0 Request processed in 620us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138213.672654:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783138213.675315:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138213.675455:0:23504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b7025400/0x6bc248e9a4e97bc4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97bcb expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.675602:0:23504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b7025400/0x6bc248e9a4e97bc4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97bcb expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138213.675719:0:23504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783138213.675790:0:23504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025400/0x6bc248e9a4e97bc4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97bcb expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.675823:0:23504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7025400/0x6bc248e9a4e97bc4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97bcb expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138213.675835:0:23504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9557828c9000 10000000:01000000:3.0:1783138213.675841:0:23504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783138213.675847:0:23504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9557828c9000 from 1 10000000:01000000:3.0:1783138213.675850:0:23504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783138213.675886:0:23504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024600/0x6bc248e9a4e97bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.675894:0:23504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b7024600/0x6bc248e9a4e97bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.675904:0:23504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b7024600/0x6bc248e9a4e97bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138213.675925:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138213.675997:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.676059:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883ef3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138213.676307:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333187584 00000100:00100000:2.0:1783138213.676316:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333187584 00000100:00100000:2.0:1783138213.676390:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783138213.676399:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+13:23504:x1869755333187584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138213.676415:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138213.676430:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2600/0x6bc248e9a4e97bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97bd2 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.676454:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2600/0x6bc248e9a4e97bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97bd2 expref: 14 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.676683:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2600/0x6bc248e9a4e97bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97bd2 expref: 14 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.676693:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2600, rc 0) 00000100:00100000:2.0:1783138213.676765:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+14:23504:x1869755333187584:12345-0@lo:101:mount.lustre.0 Request processed in 366us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138213.676832:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783138213.677068:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138213.677084:0:23504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b7024600/0x6bc248e9a4e97bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97bd9 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138213.677093:0:23504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b7024600/0x6bc248e9a4e97bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97bd9 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138213.677107:0:23504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783138213.677625:0:23504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024600/0x6bc248e9a4e97bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97bd9 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138213.678117:0:23504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7024600/0x6bc248e9a4e97bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97bd9 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138213.678125:0:23504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783138213.678134:0:23504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138213.678140:0:23504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9557828c9000 10000000:01000000:1.0:1783138213.678143:0:23504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783138213.678147:0:23504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1783138213.678150:0:23504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783138213.678180:0:23504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302ba00/0x6bc248e9a4e97be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138213.678187:0:23504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302ba00/0x6bc248e9a4e97be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138213.678334:0:23504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302ba00/0x6bc248e9a4e97be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138213.678368:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138213.678446:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.678524:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333187712 00000100:00100000:3.0:1783138213.678540:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333187712 00000100:00100000:3.0:1783138213.678595:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783138213.678604:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+14:23504:x1869755333187712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138213.678616:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138213.678649:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b7025600/0x6bc248e9a4e97be7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97be0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.678672:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b7025600/0x6bc248e9a4e97be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97be0 expref: 15 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.678691:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b7025600/0x6bc248e9a4e97be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97be0 expref: 15 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.678698:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b7025600, rc 0) 00000100:00100000:3.0:1783138213.678747:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333187712:12345-0@lo:101:mount.lustre.0 Request processed in 143us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138213.678754:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783138213.679676:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b70d8000 going to sleep for 11 seconds 00000100:00100000:1.0:1783138213.679705:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138213.679722:0:23504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302ba00/0x6bc248e9a4e97be0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97be7 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138213.679742:0:23504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302ba00/0x6bc248e9a4e97be0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97be7 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138213.682317:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1783138213.683961:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138213.698946:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1783138213.699002:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1783138213.699018:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1783138213.699444:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1783138213.699471:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1783138213.699486:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1783138213.699500:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1783138213.699516:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1783138213.699951:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1783138213.699971:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1783138213.699986:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1783138213.699999:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1783138213.700010:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1783138213.700023:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1783138213.700153:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1783138213.700170:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1783138213.700184:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1783138213.700321:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1783138213.700461:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1783138213.700481:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1783138213.700515:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1783138213.700601:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1783138213.700622:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1783138213.700704:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1783138213.700720:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1783138213.700746:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1783138213.700761:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1783138213.700847:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1783138213.700868:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1783138213.700883:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1783138213.700897:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1783138213.700910:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1783138213.700925:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1783138213.700939:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1783138213.700953:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1783138213.700968:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1783138213.700982:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1783138213.700995:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1783138213.701009:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1783138213.701021:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1783138213.701112:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1783138213.701132:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1783138213.701145:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1783138213.701158:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1783138213.701190:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1783138213.701325:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1783138213.701850:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138213.701921:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138213.702010:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9557834ddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783138213.702135:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333187840 00000100:00100000:3.0:1783138213.702144:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333187840 00000100:00100000:3.0:1783138213.702360:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783138213.702376:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333187840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138213.702545:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333187840:12345-0@lo:501:mount.lustre.0 Request processed in 176us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138213.702554:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783138213.702675:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138213.702719:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138213.702799:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138213.703516:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9557834ddd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138213.703749:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333187968 00000100:00100000:1.0:1783138213.703766:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333187968 00000100:00100000:1.0:1783138213.703805:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783138213.703812:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333187968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138213.705043:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333187968:12345-0@lo:503:mount.lustre.0 Request processed in 1213us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138213.705057:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783138213.705263:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333187968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783138213.706100:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138213.706204:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333188096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138213.706279:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138213.706326:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9557834ddd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138213.706523:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333188096 00000100:00100000:1.0:1783138213.706530:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333188096 00000100:00100000:1.0:1783138213.706577:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783138213.706586:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333188096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138213.707834:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333188096:12345-0@lo:502:mount.lustre.0 Request processed in 1243us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138213.707846:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783138213.708014:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333188096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138213.708319:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1783138213.708701:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1783138213.708723:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1783138213.708749:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1783138213.708766:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1783138213.708791:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1783138213.708807:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1783138213.708821:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1783138213.708834:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1783138213.708855:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1783138213.708871:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1783138213.708885:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1783138213.708899:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1783138213.708912:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1783138213.708925:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1783138213.708938:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1783138213.708952:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1783138213.708964:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1783138213.708978:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1783138213.708992:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1783138213.709005:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1783138213.709043:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1783138213.709058:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1783138213.709071:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1783138213.709083:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1783138213.709096:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1783138213.709110:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1783138213.709122:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1783138213.709133:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1783138213.709144:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1783138213.709157:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1783138213.709170:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1783138213.709183:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1783138213.709208:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1783138213.709235:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1783138213.709249:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1783138213.709277:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1783138213.709293:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1783138213.709305:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1783138213.709317:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1783138213.709330:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1783138213.709353:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1783138213.709761:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1783138213.709846:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1783138213.709891:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333188224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138213.709955:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138213.709987:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9557834ddd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138213.710140:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333188224 00000100:00100000:1.0:1783138213.710147:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333188224 00000100:00100000:1.0:1783138213.710205:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783138213.710215:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333188224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138213.710330:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333188224:12345-0@lo:502:mount.lustre.0 Request processed in 116us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138213.710337:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783138213.710996:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333188224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138213.711506:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1783138213.711519:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1783138213.714740:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138213.714755:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138213.714772:0:23508:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783138213.714888:0:23508:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783138213.714892:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783138213.714912:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9558b18399c0) 00000020:00000080:0.0:1783138213.714941:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1783138213.714948:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783138213.715134:0:23508:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783138213.715143:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6bc248e9a4e97bf5 00000020:00000080:0.0:1783138213.715758:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783138213.715764:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138213.715768:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138213.715770:0:23508:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783138213.715773:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138213.715891:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138213.715893:0:23508:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783138213.715898:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783138213.715907:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9558b1838000) 00000020:00000080:0.0:1783138213.715920:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1783138213.715924:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783138213.715926:0:23508:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783138213.715928:0:23508:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783138213.715934:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783138213.715982:0:23508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9557828c9000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783138213.715994:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9558b183cd40) 00000020:00000080:0.0:1783138213.716003:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1783138213.716143:0:23508:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783138213.716149:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6bc248e9a4e97c0a 00000020:00000080:0.0:1783138213.716555:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1783138213.716563:0:23508:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783138213.716568:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6bc248e9a4e97c11 00080000:01000000:0.0:1783138213.716575:0:23508:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783138213.716579:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6bc248e9a4e97c18 00010000:00010000:3.0:1783138213.866964:0:23508:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1783138213.868078:0:23508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1783138213.868940:0:23508:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783138213.874786:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1783138213.874806:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138213.874816:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138213.874818:0:23508:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1783138213.874822:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138213.874830:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138213.874831:0:23508:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1783138213.874835:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783138213.874853:0:23508:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:00000080:2.0:1783138213.874890:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138213.874910:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9558b5d20000) 00000020:00000080:2.0:1783138213.874937:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1783138213.874942:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783138213.875044:0:23508:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1783138213.875052:0:23508:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783138213.875059:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6bc248e9a4e97c26 00010000:00080000:2.0:1783138213.875096:0:23508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9558b9504800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1783138213.879507:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138213.897962:0:23508:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1783138213.900683:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783138213.900698:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783138213.900779:0:23508:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783138213.900800:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6bc248e9a4e97c2d 00000100:00080000:3.0:1783138213.900810:0:23508:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138213.900816:0:23508:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9558b9504800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138213.900990:0:23508:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558ace48e00 x1869755333188352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138213.901017:0:23508:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1783138213.901073:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.901076:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.901078:0:23508:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1783138213.901080:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783138213.901083:0:23508:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783138213.901084:0:23508:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138213.901086:0:23508:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138213.901087:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783138213.901089:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.901090:0:23508:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783138213.901092:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138213.901096:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.901098:0:23508:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1783138213.901102:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783138213.901130:0:23508:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783138213.901142:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.901145:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.901147:0:23508:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1783138213.901149:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783138213.901151:0:23508:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1783138213.901152:0:23508:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138213.901154:0:23508:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138213.901156:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783138213.901158:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.901159:0:23508:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783138213.901162:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783138213.901165:0:23508:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783138213.901168:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.901170:0:23508:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783138213.901172:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783138213.901176:0:23508:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1783138213.901272:0:23508:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783138213.901275:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783138213.901293:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9558b71a19c0) 00000020:00000080:3.0:1783138213.901304:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783138213.901310:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783138213.901482:0:23508:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1783138213.901489:0:23508:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783138213.901495:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6bc248e9a4e97c3b 00010000:00080000:3.0:1783138213.901525:0:23508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9558c1ec6000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783138213.901767:0:23508:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1783138213.901899:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333188352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138213.901968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138213.902028:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333188352 00000100:00100000:2.0:1783138213.902035:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333188352 00000100:00100000:2.0:1783138213.902076:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138213.902083:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869755333188352:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783138213.902106:0:22777:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:2.0:1783138213.902131:0:22777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6bc248e9a4e97c42 00000004:00100000:2.0:1783138213.902146:0:22777:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783138213.902152:0:22777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1783138213.902567:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783138213.902573:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783138213.902577:0:38:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138213.902582:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:0.0:1783138213.902587:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783138213.902591:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95578431a800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138213.902649:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2dc00 x1869755333188480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138213.902665:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138213.902669:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138213.902671:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138213.902674:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783138213.902713:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869755333188608:0@lo:400:kworker.0 00000100:00100000:0.0:1783138213.902768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138213.903602:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333188608 00000100:00100000:0.0:1783138213.903610:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333188608 00000100:00100000:0.0:1783138213.903678:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783138213.903687:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869755333188608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138213.903756:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869755333188608:12345-0@lo:400:kworker.0 Request processed in 70us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138213.903764:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783138213.905334:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff955889f2c700 x1869755333188608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138213.905353:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869755333188608:0@lo:400:kworker.0 00000040:01000000:3.0:1783138213.906625:0:23508:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783138213.907043:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333188480:0@lo:38:kworker.0 00000100:00100000:2.0:1783138213.907134:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138213.907202:0:22776:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1783138213.907210:0:22776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:3.0:1783138213.907948:0:23508:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1783138213.909237:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333188480 00000100:00100000:3.0:1783138213.909248:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333188480 00000100:00100000:1.0:1783138213.910156:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138213.910167:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1869755333188480:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783138213.910283:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1869755333188480:12345-0@lo:38:kworker.0 Request processed in 115us (3149us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783138213.910290:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138213.910419:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783138213.910429:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138213.910434:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783138213.910438:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333188480:0@lo:38:kworker.0 00000040:00080000:1.0:1783138213.915140:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138213.916156:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1783138213.916349:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:3.0:1783138213.917413:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138213.917511:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1869755333188352:12345-0@lo:38:llog_process_th.0 Request processed in 15424us (15540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138213.917531:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138213.917692:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783138213.917702:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1783138213.917710:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783138213.917716:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783138213.917719:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b9504800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783138213.917738:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333188352:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1783138213.918141:0:23514:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783138213.918145:0:23514:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1783138213.918791:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333188736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138213.918859:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138213.919473:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333188736 00000100:00100000:0.0:1783138213.919482:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333188736 00000100:00100000:0.0:1783138213.919544:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138213.919553:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869755333188736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783138213.919588:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138213.919660:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869755333188736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138213.919667:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783138213.919992:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333188736:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1783138213.920706:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783138213.920735:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783138213.920948:0:23508:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783138213.920975:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6bc248e9a4e97c49 00000100:00080000:3.0:1783138213.920985:0:23508:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138213.920992:0:23508:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9558c1ec6000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138213.921028:0:23508:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558ace4b800 x1869755333188864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138213.921054:0:23508:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783138213.921176:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333188864:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1783138213.921178:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.921182:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.921184:0:23508:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783138213.921187:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783138213.921200:0:23508:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1783138213.921206:0:23508:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138213.921208:0:23508:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783138213.921210:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783138213.921213:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.921214:0:23508:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783138213.921216:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783138213.921222:0:23508:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783138213.921225:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.921227:0:23508:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783138213.921230:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783138213.921234:0:23508:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1783138213.921254:0:23508:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783138213.921256:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783138213.921270:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9558b71a0000) 00000020:00000080:3.0:1783138213.921294:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1783138213.921300:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783138213.921362:0:23508:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783138213.921382:0:23508:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783138213.921388:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6bc248e9a4e97c57 00010000:00080000:3.0:1783138213.921418:0:23508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9558c1ec2000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783138213.921673:0:23508:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783138213.921753:0:23508:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783138213.921768:0:23508:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000400:00000100:1.0:1783138213.922845:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333188864 offset 0 length 520: 4 00000040:00080000:3.0:1783138213.929493:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138213.930484:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1783138213.930685:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00080000:1.0:1783138213.931541:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138213.931547:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138213.931558:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138213.931561:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1783138213.932083:0:23516:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783138213.932088:0:23516:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783138213.934912:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783138213.934931:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783138213.934983:0:23508:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783138213.935006:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6bc248e9a4e97c5e 00000100:00080000:3.0:1783138213.935017:0:23508:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138213.935024:0:23508:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9558c1ec2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138213.935069:0:23508:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558ace48000 x1869755333188992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138213.935126:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333188992:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783138213.935208:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333188992 offset 0 length 520: 4 00000100:00080000:3.0:1783138213.935314:0:23508:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783138213.935373:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.935378:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.935380:0:23508:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783138213.935382:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138213.935386:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.935388:0:23508:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783138213.935391:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783138213.935393:0:23508:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783138213.935395:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.935397:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.935398:0:23508:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783138213.935400:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138213.935403:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.935404:0:23508:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783138213.935408:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783138213.935439:0:23508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.935443:0:23508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.935444:0:23508:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783138213.935447:0:23508:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1783138213.935501:0:23504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1783138213.935541:0:23504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00080000:0.0:1783138213.936026:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138213.936032:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138213.936035:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138213.936037:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783138213.936246:0:23504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302ba00/0x6bc248e9a4e97be0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97be7 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.936259:0:23504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302ba00/0x6bc248e9a4e97be0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97be7 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138213.936269:0:23504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9557828c9000 from 1 10000000:01000000:3.0:1783138213.936272:0:23504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783138213.936314:0:23504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.936324:0:23504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.936336:0:23504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138213.936356:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138213.936408:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.936435:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff95588bc84c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783138213.938812:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333189120 00000100:00100000:0.0:1783138213.938830:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333189120 00000100:00100000:0.0:1783138213.938907:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783138213.938917:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+15:23504:x1869755333189120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138213.938935:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138213.938952:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97c65 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.938990:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.939003:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.939012:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9557834de200, rc 0) 00000100:00100000:0.0:1783138213.939103:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:23504:x1869755333189120:12345-0@lo:101:mount.lustre.0 Request processed in 188us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138213.939111:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783138213.939146:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138213.939165:0:23504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.939174:0:23504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138213.939994:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783138213.940045:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.940072:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff95588bc84c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783138213.940286:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333189248 00000100:00100000:2.0:1783138213.940292:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333189248 00000100:00100000:2.0:1783138213.940335:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783138213.940344:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:23504:x1869755333189248:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783138213.940359:0:22765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783138213.940378:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783138213.940382:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1783138213.940481:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:23504:x1869755333189248:12345-0@lo:256:mount.lustre.0 Request processed in 137us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138213.940488:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783138213.940783:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189248:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783138213.941687:0:23504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783138213.941716:0:23504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.941735:0:23504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138213.941744:0:23504:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9557828c9000 from 1 10000000:01000000:2.0:1783138213.941747:0:23504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138213.941788:0:23504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.941797:0:23504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.941807:0:23504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138213.941826:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138213.942082:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138213.942109:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955882c18cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138213.942174:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333189376 00000100:00100000:0.0:1783138213.942180:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333189376 00000100:00100000:0.0:1783138213.942290:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783138213.942299:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:23504:x1869755333189376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138213.942309:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138213.942321:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97c73 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.942356:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.942622:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.942654:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9557834df800, rc 0) 00000100:00100000:0.0:1783138213.942702:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189376:12345-0@lo:101:mount.lustre.0 Request processed in 405us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138213.942709:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783138213.942752:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138213.942766:0:23504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.942776:0:23504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138213.947836:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1783138213.948145:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138213.948350:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1783138213.948376:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1783138213.948390:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1783138213.948402:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1783138213.948414:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1783138213.948427:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1783138213.948442:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1783138213.948457:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1783138213.948470:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1783138213.948484:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1783138213.948498:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1783138213.948515:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1783138213.948520:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1783138213.948908:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138213.948976:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.949014:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff95588bc84000 going to sleep for 11 seconds 00000100:00100000:0.0:1783138213.951563:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333189504 00000100:00100000:0.0:1783138213.951579:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333189504 00000100:00100000:0.0:1783138213.951680:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783138213.951691:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138213.951931:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189504:12345-0@lo:501:mount.lustre.0 Request processed in 240us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138213.951955:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783138213.951962:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138213.952014:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138213.952061:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.952097:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff95588bc84000 going to sleep for 11 seconds 00000100:00100000:0.0:1783138213.952572:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333189632 00000100:00100000:0.0:1783138213.952578:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333189632 00000100:00100000:2.0:1783138213.952958:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783138213.952970:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189632:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138213.953120:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189632:12345-0@lo:503:mount.lustre.0 Request processed in 153us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138213.953127:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783138213.953268:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189632:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783138213.953822:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138213.954042:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138213.954090:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.959336:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558898a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138213.960014:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333189760 00000100:00100000:1.0:1783138213.960026:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333189760 00000100:00100000:1.0:1783138213.960081:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783138213.960091:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138213.966016:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189760:12345-0@lo:502:mount.lustre.0 Request processed in 5917us (11916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138213.966032:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783138213.966090:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138213.966363:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783138213.966397:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1783138213.966411:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1783138213.966436:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1783138213.966448:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1783138213.966460:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1783138213.966471:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1783138213.966481:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1783138213.966492:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783138213.966535:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1783138213.966769:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1783138213.966814:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138213.966863:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.966893:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff95588bc84780 going to sleep for 11 seconds 00000100:00100000:1.0:1783138213.966998:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333189888 00000100:00100000:1.0:1783138213.967006:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333189888 00000100:00100000:1.0:1783138213.967036:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783138213.967042:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138213.967208:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333189888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138213.967259:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1783138213.967266:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783138213.967870:0:23518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138213.967881:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.967883:0:23518:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783138213.967891:0:23518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9557828c9000 00000020:00000080:3.0:1783138213.967893:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138213.967902:0:23518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.967904:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.967905:0:23518:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783138213.967908:0:23518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138213.967910:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.967911:0:23518:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783138213.967915:0:23518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9557828c9000 00000020:00000080:3.0:1783138213.967916:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138213.967971:0:23518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.967974:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.967975:0:23518:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783138213.967978:0:23518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138213.967987:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.967988:0:23518:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138213.967992:0:23518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9557828c9000 00000020:00000080:3.0:1783138213.967994:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138213.968014:0:23518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.968017:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.968018:0:23518:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138213.968021:0:23518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138213.968023:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.968024:0:23518:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783138213.968027:0:23518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9557828c9000 00000020:00000080:3.0:1783138213.968029:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138213.968051:0:23518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138213.968054:0:23518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138213.968056:0:23518:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783138213.968059:0:23518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1783138213.968095:0:23504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783138213.968115:0:23504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783138213.968130:0:23504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138213.968242:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333189888:12345-0@lo:502:mount.lustre.0 Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138213.968252:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1783138213.969301:0:23504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138213.969367:0:23504:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783138213.969370:0:23504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9557828c9000 10000000:01000000:3.0:1783138213.969374:0:23504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9557828c9000 10000000:01000000:3.0:1783138213.969378:0:23504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783138213.969383:0:23504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9557828c9000 from 1 10000000:01000000:3.0:1783138213.969386:0:23504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783138213.969417:0:23504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025c00/0x6bc248e9a4e97c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.969436:0:23504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b7025c00/0x6bc248e9a4e97c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138213.969447:0:23504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b7025c00/0x6bc248e9a4e97c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138213.969469:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138213.970305:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138213.970346:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff95588bc84180 going to sleep for 11 seconds 00000100:00100000:2.0:1783138213.970718:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333190016 00000100:00100000:2.0:1783138213.970736:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333190016 00000100:00100000:2.0:1783138213.970793:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783138213.970803:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:23504:x1869755333190016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138213.970826:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138213.970855:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa3600/0x6bc248e9a4e97c88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97c81 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.970883:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa3600/0x6bc248e9a4e97c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97c81 expref: 18 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.970894:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa3600/0x6bc248e9a4e97c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97c81 expref: 18 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138213.970901:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa3600, rc 0) 00000100:00100000:2.0:1783138213.971106:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190016:12345-0@lo:101:mount.lustre.0 Request processed in 304us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138213.971113:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783138213.972074:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138213.972095:0:23504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b7025c00/0x6bc248e9a4e97c81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c88 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138213.972106:0:23504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b7025c00/0x6bc248e9a4e97c81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97c88 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783138213.979464:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1783138213.980997:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138213.981228:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1783138213.981255:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1783138213.981268:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1783138213.981280:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1783138213.981292:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1783138213.981305:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1783138213.981317:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1783138213.981330:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1783138213.981343:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1783138213.981355:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1783138213.983030:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1783138213.983066:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1783138213.983094:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1783138213.983116:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1783138213.983132:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1783138213.983146:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1783138213.983161:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1783138213.983175:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1783138213.983188:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1783138213.983202:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1783138213.983216:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1783138213.983231:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1783138213.983245:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1783138213.983258:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1783138213.983272:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1783138213.983286:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1783138213.983318:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1783138213.983334:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1783138213.983348:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1783138213.983361:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1783138213.983373:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1783138213.983385:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1783138213.983398:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1783138213.983412:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1783138213.983426:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1783138213.983439:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1783138213.983453:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1783138213.983468:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1783138213.983481:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1783138213.983494:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1783138213.983508:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1783138213.983522:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1783138213.983548:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1783138213.983564:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1783138213.983612:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1783138213.983662:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1783138213.983678:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1783138213.983690:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1783138213.984520:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1783138213.984557:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1783138213.984578:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1783138213.984583:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1783138213.984707:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138213.985448:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138213.985491:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333190144 00000100:00100000:0.0:1783138213.985498:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333190144 00000100:00100000:0.0:1783138213.985590:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783138213.985602:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138213.985763:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190144:12345-0@lo:501:mount.lustre.0 Request processed in 164us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138213.985782:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783138213.986761:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558898a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1783138213.986793:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138213.986844:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138213.986906:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138213.994854:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0e300 going to sleep for 11 seconds 00000100:00100000:2.0:1783138214.001111:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333190272 00000100:00100000:2.0:1783138214.001127:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333190272 00000100:00100000:2.0:1783138214.001197:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783138214.001208:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138214.001473:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190272:12345-0@lo:503:mount.lustre.0 Request processed in 267us (14566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138214.001482:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783138214.001552:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783138214.002186:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783138214.002335:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138214.002453:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138214.002487:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955882dd1540 going to sleep for 11 seconds 00000100:00100000:2.0:1783138214.002508:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333190400 00000100:00100000:2.0:1783138214.002518:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333190400 00000100:00100000:2.0:1783138214.002550:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138214.002557:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138214.002666:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190400:12345-0@lo:502:mount.lustre.0 Request processed in 109us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138214.002673:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138214.002720:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138214.003344:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1783138214.003450:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1783138214.003467:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1783138214.003480:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1783138214.003492:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1783138214.003504:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1783138214.003518:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1783138214.003532:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1783138214.003558:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1783138214.003573:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1783138214.003584:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1783138214.003595:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1783138214.003607:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1783138214.003620:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1783138214.003654:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1783138214.003668:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1783138214.003680:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1783138214.003691:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1783138214.003701:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1783138214.003712:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1783138214.003735:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1783138214.003749:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1783138214.003761:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1783138214.004071:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1783138214.004099:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1783138214.004115:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1783138214.004127:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1783138214.004139:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1783138214.004152:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1783138214.004164:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1783138214.004176:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1783138214.004258:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1783138214.004279:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1783138214.004293:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1783138214.004306:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1783138214.004319:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1783138214.004332:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1783138214.004346:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1783138214.004360:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1783138214.004451:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1783138214.004478:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1783138214.004493:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1783138214.004506:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1783138214.004520:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1783138214.004535:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1783138214.004546:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1783138214.004559:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1783138214.004573:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1783138214.004620:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138214.005014:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138214.005049:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955882dd1540 going to sleep for 11 seconds 00000100:00100000:2.0:1783138214.005069:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333190528 00000100:00100000:2.0:1783138214.005075:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333190528 00000100:00100000:2.0:1783138214.005117:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138214.005126:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138214.006132:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190528:12345-0@lo:502:mount.lustre.0 Request processed in 1000us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138214.006143:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138214.006482:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138214.007345:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1783138214.007574:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1783138214.007624:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138214.008349:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138214.008491:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955882dd1540 going to sleep for 11 seconds 00000100:00100000:0.0:1783138214.012515:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333190656 00000100:00100000:0.0:1783138214.012531:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333190656 00000100:00100000:2.0:1783138214.012696:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783138214.012708:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138214.012918:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190656:12345-0@lo:502:mount.lustre.0 Request processed in 211us (4569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138214.012927:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783138214.013006:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138214.013095:0:23504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1783138214.013109:0:23504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783138214.015820:0:23523:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783138214.015854:0:23523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff955783a13380) 00000020:00000080:0.0:1783138214.015881:0:23523:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1783138214.016064:0:23523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9557828c9000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783138214.016068:0:23523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9557828c9000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783138214.016071:0:23523:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9557828c9000 3 00010000:00080000:0.0:1783138214.016104:0:23523:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9558a559f800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1783138214.017760:0:23523:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1783138214.017892:0:23523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783138214.017937:0:23523:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783138214.017951:0:23523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6bc248e9a4e97c96 00000100:00080000:0.0:1783138214.017964:0:23523:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138214.017975:0:23523:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9558a559f800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138214.018018:0:23523:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2df80 x1869755333190784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138214.018056:0:23523:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783138214.018080:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869755333190784:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1783138214.018083:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138214.018088:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138214.018090:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138214.018093:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783138214.018170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138214.023080:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333190784 00000100:00100000:0.0:1783138214.023094:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333190784 00000100:00100000:0.0:1783138214.023141:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783138214.023150:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869755333190784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783138214.023958:0:22773:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:0.0:1783138214.024009:0:22773:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6bc248e9a4e97c9d 00000004:00100000:0.0:1783138214.024032:0:22773:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783138214.024085:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9558a5757000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138214.024183:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1869755333190784:12345-0@lo:38:llog_process_th.0 Request processed in 1032us (6011us total) trans 0 rc 0/0 00010000:00080000:1.0:1783138214.024383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff955889f2df80 x1869755333190784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138214.024397:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783138214.024407:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1783138214.024416:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783138214.024421:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783138214.024424:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558a559f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783138214.024430:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869755333190784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783138214.027096:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1783138214.027307:0:23523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1783138214.029979:0:23504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783138214.030022:0:23504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783138214.030045:0:23504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025c00/0x6bc248e9a4e97c81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c88 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.030058:0:23504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7025c00/0x6bc248e9a4e97c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97c88 expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783138214.030116:0:23504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783138214.030123:0:23504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783138214.030124:0:23504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138214.030125:0:23504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138214.030126:0:23504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138214.030127:0:23504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138214.030129:0:23504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783138214.030130:0:23504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138214.030131:0:23504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783138214.030136:0:23504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1783138214.030138:0:23504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138214.030139:0:23504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783138214.030140:0:23504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138214.030141:0:23504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138214.030142:0:23504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138214.030143:0:23504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138214.030144:0:23504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783138214.030145:0:23504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138214.030146:0:23504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783138214.030177:0:23504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783138214.030213:0:23504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138214.030294:0:23504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138214.030335:0:23504:0:(client.c:2701:ptlrpc_set_wait()) set ffff955882dd1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138214.030362:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333190912 00000100:00100000:2.0:1783138214.030503:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333190912 00000100:00100000:2.0:1783138214.030555:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783138214.030566:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783138214.030597:0:22766:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783138214.030612:0:22766:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1783138214.035821:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1783138214.035882:0:22766:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783138214.035896:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783138214.036319:0:22787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783138214.036325:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783138214.036350:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138214.036437:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138214.036459:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 18 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138214.036468:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138214.036508:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 18 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138214.036523:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 18 pid: 22766 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138214.036540:0:22787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333191040:0@lo:104: 00000100:00100000:0.0:1783138214.036608:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783138214.036681:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138214.036690:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 18 pid: 22764 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138214.036698:0:22787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333191168:0@lo:104: 00000100:00100000:0.0:1783138214.036720:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138214.036747:0:22787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138214.036778:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333191040 00000100:00100000:1.0:1783138214.036785:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333191040 00000100:00100000:1.0:1783138214.036825:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333191168 00000100:00100000:1.0:1783138214.036828:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333191168 00000100:00100000:1.0:1783138214.036841:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783138214.036849:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+4:22787:x1869755333191040:12345-0@lo:104: 00010000:00010000:1.0:1783138214.036863:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.036913:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783138214.036918:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+4:22787:x1869755333191040:12345-0@lo:104: Request processed in 70us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138214.036925:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783138214.036941:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138214.036946:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:22787:x1869755333191168:12345-0@lo:104: 00010000:00010000:1.0:1783138214.036959:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.036990:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783138214.036995:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:22787:x1869755333191168:12345-0@lo:104: Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138214.037002:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138214.037037:0:22787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333191040:0@lo:104: 00000100:00100000:1.0:1783138214.037044:0:22787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333191168:0@lo:104: 00010000:00010000:1.0:1783138214.037063:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.037081:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138214.037086:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.037093:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7025800 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138214.037097:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.037105:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138214.037112:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138214.037117:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1783138214.037328:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:23504:x1869755333190912:12345-0@lo:253:mount.lustre.0 Request processed in 6762us (7033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138214.037336:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783138214.037397:0:23504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:23504:1869755333190912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783138214.037407:0:23504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783138214.037410:0:23504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783138214.037412:0:23504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783138214.037413:0:23504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138214.037414:0:23504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138214.037415:0:23504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138214.037416:0:23504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138214.037418:0:23504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783138214.037419:0:23504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138214.037420:0:23504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783138214.037430:0:23504:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783138214.038831:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.038853:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138214.038884:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.038892:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7025800/0x6bc248e9a4e97c65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97c6c expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138214.038894:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783138214.038904:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138214.038908:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138214.038911:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333191296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138214.038914:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7024e00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138214.038917:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.038926:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138214.038932:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138214.038937:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783138214.038952:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.038957:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783138214.038962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783138214.038972:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.038978:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7024e00/0x6bc248e9a4e97ba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97ba8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.038995:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138214.038996:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138214.038998:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138214.039003:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138214.039024:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333191424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138214.039051:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138214.039087:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333191296 00000100:00100000:1.0:1783138214.039093:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333191296 00010000:00010000:1.0:1783138214.039115:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 18 pid: 22766 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138214.040079:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333191424 00000100:00100000:2.0:1783138214.040087:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333191424 00010000:00010000:2.0:1783138214.040106:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 19 pid: 22764 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138214.040126:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138214.040133:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:3645:x1869755333191296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138214.040146:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138214.040151:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 19 pid: 22766 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.040162:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 19 pid: 22766 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.040175:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834de200/0x6bc248e9a4e97c6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97c65 expref: 19 pid: 22766 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.040257:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138214.040308:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3645:x1869755333191296:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138214.040315:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138214.040333:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138214.040339:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:3647:x1869755333191424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138214.040346:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138214.040350:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 17 pid: 22764 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.040358:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 17 pid: 22764 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041517:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97ba8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97ba1 expref: 17 pid: 22764 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041538:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041546:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783138214.041567:0:22758:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009479714s 00010000:00010000:2.0:1783138214.041573:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041579:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041597:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041604:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041610:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138214.041616:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041625:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041657:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138214.041668:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138214.041734:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:3647:x1869755333191424:12345-0@lo:103:ldlm_bl.0 Request processed in 1394us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138214.041743:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138214.041807:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333191296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138214.044169:0:22787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.044186:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138214.044193:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834df000/0x6bc248e9a4e97ca4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138214.044258:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333191424:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1783138214.058318:0:23504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1783138214.058657:0:23530:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1783138214.058662:0:23530:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783138214.058853:0:23531:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1783138214.059252:0:23531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783138214.059566:0:23504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1783138214.059906:0:23532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1869755333191552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783138214.059970:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138214.059992:0:23532:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138214.060039:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333191552 00000100:00100000:3.0:1783138214.060045:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333191552 00000100:00100000:3.0:1783138214.060083:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783138214.060091:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23532:x1869755333191552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783138214.060185:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23532:x1869755333191552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138214.060193:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:3.0:1783138214.060328:0:23504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783138214.060362:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783138214.060859:0:23504:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783138214.060868:0:23504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1783138214.060909:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138214.062152:0:23504:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783138214.062768:0:23504:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783138214.062801:0:23504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1783138214.062902:0:23504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783138214.063440:0:23504:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1783138214.063959:0:23532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1869755333191552:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1783138214.063994:0:23532:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783138214.064033:0:23532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1869755333191680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783138214.064095:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138214.064127:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333191680 00000100:00100000:1.0:1783138214.064143:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333191680 00000100:00100000:1.0:1783138214.064185:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138214.064193:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23532:x1869755333191680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783138214.064306:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23532:x1869755333191680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 113us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138214.064314:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138214.064335:0:23532:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0ecc0 going to sleep for 11 seconds 00000040:00080000:2.0:1783138214.064337:0:23531:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1783138214.064347:0:23532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1869755333191680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783138214.064498:0:23532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23532:1869755333191808:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783138214.064526:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138214.064547:0:23532:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138214.064579:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333191808 00000100:00100000:0.0:1783138214.064586:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333191808 00000100:00100000:0.0:1783138214.064620:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138214.064643:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23532:x1869755333191808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783138214.064689:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23532:x1869755333191808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138214.064702:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1783138214.065005:0:23531:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00080000:1.0:1783138214.065022:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9558b17c6a00 x1869755333191808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783138230 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138214.065032:0:23532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23532:1869755333191808:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783138214.065076:0:23532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1869755333191936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783138214.065104:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138214.065129:0:23532:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138214.065265:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333191936 00000100:00100000:0.0:1783138214.065270:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333191936 00000100:00100000:0.0:1783138214.065302:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138214.065308:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1869755333191936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783138214.065374:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1869755333191936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 56us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138214.065380:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783138214.065670:0:23532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1869755333191936:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783138214.065718:0:23532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138214.072802:0:23532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783138214.072885:0:23532:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783138214.072889:0:23532:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1783138214.087781:0:23504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1783138214.090411:0:23504:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783138214.090452:0:23504:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb797419fb988 00100000:10000000:2.0:1783138214.090461:0:23504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1783138214.092584:0:23504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783138214.092671:0:23504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783138214.092689:0:23504:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783138214.092713:0:23504:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783138214.098140:0:23504:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783138214.099247:0:23504:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783138214.200693:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:3.0:1783138214.902549:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783138215.094242:0:23528:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783138215.224589:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 10000000:01000000:1.0:1783138215.224933:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783138215.224938:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9557828c9000 from 12 10000000:01000000:1.0:1783138215.224942:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783138215.224999:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138215.225011:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138215.225022:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138215.225178:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333192064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138215.226902:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138215.226961:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558898a0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783138215.227062:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333192064 00000100:00100000:2.0:1783138215.227070:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333192064 00000100:00100000:2.0:1783138215.227136:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783138215.227144:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:22768:x1869755333192064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138215.227160:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138215.227177:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97cab expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138215.227211:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 17 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138215.227222:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 17 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138215.227231:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2400, rc 0) 00000100:00100000:2.0:1783138215.227295:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333192064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138215.227302:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783138215.227729:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333192064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138215.227748:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138215.227759:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138215.227835:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333192192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783138215.227876:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138215.227905:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558898a0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783138215.228028:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333192192 00000100:00100000:2.0:1783138215.228033:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333192192 00000100:00100000:2.0:1783138215.228073:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783138215.228080:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333192192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138215.228096:0:22766:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138215.228118:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138215.228121:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1783138215.228216:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333192192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138215.228223:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783138215.228673:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333192192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783138215.228735:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783138215.228748:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138215.228757:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138215.228769:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783138215.228772:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9558b1cfd000 from 12 10000000:01000000:1.0:1783138215.228774:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783138215.228797:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138215.228806:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138215.228816:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138215.228833:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333192320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138215.228868:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138215.228901:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5b900 going to sleep for 11 seconds 00000100:00100000:0.0:1783138215.228982:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333192320 00000100:00100000:0.0:1783138215.228988:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333192320 00000100:00100000:0.0:1783138215.229010:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783138215.229015:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333192320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138215.229023:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138215.229035:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97cb9 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138215.229053:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138215.229062:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138215.229070:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9557834dee00, rc 0) 00000100:00100000:0.0:1783138215.229108:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:22768:x1869755333192320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138215.229114:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783138215.229342:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333192320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138215.229352:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138215.229360:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138215.229399:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333192448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783138215.229760:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138215.229779:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783138215.229910:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333192448 00000100:00100000:2.0:1783138215.229915:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333192448 00000100:00100000:2.0:1783138215.229943:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783138215.229949:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:22768:x1869755333192448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138215.229964:0:22766:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138215.229981:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138215.229984:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1783138215.230080:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:22768:x1869755333192448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138215.230087:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783138215.230732:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333192448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783138215.230782:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783138215.230791:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138215.230799:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138215.925870:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783138216.118543:0:23528:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783138216.255360:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:0.0:1783138216.957742:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138217.275063:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:0.0:1783138217.974876:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138218.292795:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 0 seconds 00010000:00010000:2.0:1783138218.998664:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783138219.126386:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783138219.126401:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783138219.126405:0:38:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138219.126417:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95578431a800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138219.126439:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578406a680 x1869755333192832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138219.126453:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138219.126456:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138219.126459:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138219.126469:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138219.126484:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138219.126487:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138219.126490:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138219.126493:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783138219.126575:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333192704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138219.126678:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333192576:0@lo:400:kworker.0 00000100:00100000:1.0:1783138219.126740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138219.126740:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138219.126799:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333192576 00000100:00100000:2.0:1783138219.126807:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333192576 00000100:00100000:2.0:1783138219.128545:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783138219.128562:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3648:x1869755333192576:12345-0@lo:400:kworker.0 00000001:02000400:3.0:1783138219.129295:0:23775:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783138219.131093:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869755333193216:0@lo:400:kworker.0 00000100:00100000:1.0:1783138219.131312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138219.131365:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783138219.131373:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333193088:0@lo:400:kworker.0 00000100:00100000:0.0:1783138219.132939:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333193216 00000100:00100000:0.0:1783138219.132955:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333193216 00000100:00100000:0.0:1783138219.133038:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783138219.133050:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869755333193216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138219.133162:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869755333193216:12345-0@lo:400:kworker.0 Request processed in 113us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138219.133170:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138219.133197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138219.133212:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333192960:0@lo:400:kworker.0 00000100:00100000:0.0:1783138219.133248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783138219.133266:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95578406ad80 x1869755333193216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138219.133282:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869755333193216:0@lo:400:kworker.0 00000100:00100000:0.0:1783138219.133282:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333192704 00000100:00100000:0.0:1783138219.133285:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333192704 00000100:00100000:0.0:1783138219.133309:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333193088 00000100:00100000:0.0:1783138219.133312:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333193088 00000100:00100000:1.0:1783138219.133316:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333192832:0@lo:38:kworker.0 00000100:00100000:0.0:1783138219.133324:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138219.133330:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869755333192704:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138219.133358:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1783138219.133364:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138219.133381:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333192832 00000100:00100000:0.0:1783138219.133396:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869755333192704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (6657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138219.133403:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138219.133414:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783138219.133419:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333193088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138219.133451:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333193088:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138219.133470:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783138219.133487:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333192960 00000100:00100000:0.0:1783138219.133490:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333192960 00000100:00100000:0.0:1783138219.133509:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138219.133515:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333192960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138219.133550:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333192960:12345-0@lo:400:kworker.0 Request processed in 35us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138219.133556:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138219.133586:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333192832 00010000:00080000:0.0:1783138219.133586:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff955784069180 x1869755333192960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138219.133595:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333192960:0@lo:400:kworker.0 00000100:00100000:1.0:1783138219.133608:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783138219.133612:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1869755333192832:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783138219.133620:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333192704:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1783138219.133665:0:23513:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:1.0:1783138219.133701:0:23513:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6bc248e9a4e97cc7 00000004:00100000:1.0:1783138219.133717:0:23513:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783138219.133722:0:23513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1783138219.133841:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333193088:0@lo:400:kworker.0 00000100:00100000:2.0:1783138219.137514:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3648:x1869755333192576:12345-0@lo:400:kworker.0 Request processed in 8944us (10759us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138219.137533:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783138219.144680:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333192576:0@lo:400:kworker.0 00000100:00080000:3.0:1783138219.147812:0:23513:0:(import.c:65:import_set_state_nolock()) ffff9558a5769800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138219.147917:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1869755333192832:12345-0@lo:38:kworker.0 Request processed in 14301us (14556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138219.147928:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1783138219.147997:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1783138219.148008:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783138219.148014:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783138219.148017:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578431a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1783138219.148034:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b6bddd35): req@ffff9558ace4a680 x1869755333185792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138219.148055:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333192832:0@lo:38:kworker.0 00000100:00100000:3.0:1783138219.148143:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138219.148168:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 11 seconds 00000100:00100000:3.0:1783138219.148185:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333185792 00000100:00100000:3.0:1783138219.148192:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333185792 00000100:00100000:3.0:1783138219.148231:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783138219.148240:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22812:x1869755333185792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783138219.148531:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22812:x1869755333185792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 291us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138219.148538:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783138219.148570:0:22812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1869755333185792:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783138219.148619:0:22812:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783138219.148700:0:22812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1869755333193344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783138219.148734:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138219.148760:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b10710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138219.148770:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333193344 00000100:00100000:3.0:1783138219.148774:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333193344 00000100:00100000:3.0:1783138219.148794:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783138219.148799:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22812:x1869755333193344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783138219.148887:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22812:x1869755333193344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138219.148892:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783138219.148916:0:22812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1869755333193344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783138219.148974:0:22812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1869755333193472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783138219.148996:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138219.149010:0:22812:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883607240 going to sleep for 11 seconds 00000100:00100000:3.0:1783138219.149021:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333193472 00000100:00100000:3.0:1783138219.149024:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333193472 00000100:00100000:3.0:1783138219.149043:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783138219.149048:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1869755333193472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783138219.149089:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1869755333193472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138219.149095:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783138219.149115:0:22812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1869755333193472:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783138219.149153:0:22812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138219.151154:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138219.151173:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333193600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138219.151236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138219.153022:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333193600 00000100:00100000:2.0:1783138219.153037:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333193600 00000100:00100000:2.0:1783138219.153095:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138219.153561:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1869755333193600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138219.153603:0:23513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138219.153710:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1869755333193600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138219.153718:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138219.153776:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333193600:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783138219.161867:0:22812:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783138219.161971:0:22812:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1783138219.161976:0:22812:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1783138220.023444:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783138220.212961:0:23827:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783138220.213276:0:23827:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138221.045336:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783138221.235838:0:23877:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138221.236080:0:23877:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1783138221.436673:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783138222.068865:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783138222.260023:0:23925:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe334b8dc0 20000000:00000080:3.0:1783138222.260040:0:23925:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9558a545c800 uarg=0000000000000000 20000000:01000000:3.0:1783138222.260078:0:23925:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783138222.260085:0:23925:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783138222.260090:0:23925:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783138222.267740:0:23926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1783138222.267991:0:23925:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783138222.280601:0:23925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783138222.280689:0:23925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.280712:0:23925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 17 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.280720:0:23925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.280727:0:23925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.280794:0:23925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.280812:0:23925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 17 pid: 22766 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138222.280831:0:23925:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1869755333193728:0@lo:104: 00000100:00100000:3.0:1783138222.280911:0:23925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138222.280941:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333193728 00000100:00100000:1.0:1783138222.280950:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333193728 00010000:00010000:3.0:1783138222.280962:0:23925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 17 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.280985:0:23925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 17 pid: 22765 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138222.280993:0:23925:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1869755333193856:0@lo:104: 00000100:00100000:1.0:1783138222.281008:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783138222.281016:0:23925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138222.281017:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:23925:x1869755333193728:12345-0@lo:104: 00000100:00100000:3.0:1783138222.281026:0:23925:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a49c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783138222.281030:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138222.281095:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783138222.281101:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:23925:x1869755333193728:12345-0@lo:104: Request processed in 86us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138222.281109:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138222.281127:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333193856 00000100:00100000:1.0:1783138222.281131:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333193856 00010000:00010000:0.0:1783138222.281238:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138222.281245:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.281263:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa3800 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:0.0:1783138222.281277:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.281287:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138222.281295:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138222.281302:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783138222.281334:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.281340:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783138222.281360:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.281367:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3800/0x6bc248e9a4e97c73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97c7a expref: -99 pid: 23504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.281378:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138222.281380:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138222.281382:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138222.281390:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138222.281400:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333193984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138222.281429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138222.281479:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138222.281488:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:23925:x1869755333193856:12345-0@lo:104: 00010000:00010000:1.0:1783138222.281502:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138222.281542:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783138222.281548:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:23925:x1869755333193856:12345-0@lo:104: Request processed in 62us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138222.281555:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138222.281593:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333193984 00000100:00100000:1.0:1783138222.281597:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333193984 00010000:00010000:1.0:1783138222.281614:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 18 pid: 22766 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138222.281662:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138222.281668:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3645:x1869755333193984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138222.281678:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138222.281684:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 18 pid: 22766 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138222.281694:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 18 pid: 22766 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138222.281708:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138222.281734:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3645:x1869755333193984:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138222.281739:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138222.281769:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333193984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138222.281962:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138222.281968:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.281975:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa2800 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:0.0:1783138222.281984:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.281992:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138222.281998:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138222.282003:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783138222.282020:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282025:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783138222.282050:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282056:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2800/0x6bc248e9a4e97b70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97b77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282069:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138222.282070:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138222.282072:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138222.282105:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333194112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138222.282133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138222.282358:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333194112 00000100:00100000:0.0:1783138222.282363:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333194112 00010000:00010000:0.0:1783138222.282381:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 18 pid: 22765 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138222.282408:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138222.282414:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3647:x1869755333194112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138222.282423:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138222.282433:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 18 pid: 22765 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282442:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 18 pid: 22765 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282456:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282464:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282481:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282489:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282497:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282503:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282509:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7025000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138222.282513:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282520:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282527:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138222.282543:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138222.282591:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3647:x1869755333194112:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138222.282599:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138222.282766:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333194112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783138222.282811:0:23925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834df800/0x6bc248e9a4e97c7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97c73 expref: 17 pid: 22766 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138222.282824:0:23925:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1869755333193728:0@lo:104: 00010000:00010000:3.0:1783138222.282836:0:23925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b6fa2200/0x6bc248e9a4e97b77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97b70 expref: 16 pid: 22765 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138222.282844:0:23925:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1869755333193856:0@lo:104: 00010000:00010000:3.0:1783138222.282863:0:23925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.282873:0:23925:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.282879:0:23925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138222.282886:0:23925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7025000/0x6bc248e9a4e97cce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138223.098303:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138223.227807:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138213/real 1783138213] req@ffff9558ace48000 x1869755333188992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138223 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138223.227841:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9558ace48000 x1869755333188992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138223 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138223.227851:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138213/real 1783138213] req@ffff9558ace4b800 x1869755333188864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138223 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138223.227862:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9558ace4b800 x1869755333188864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138223 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138223.227886:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138223.227908:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783138223.227911:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333188992:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783138223.227917:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138223.227921:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783138223.227924:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333188864:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783138223.228064:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138223.228068:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138223.228071:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138223.228074:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138223.228091:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138223.228094:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783138223.228097:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138223.228103:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1783138223.228107:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138223.228114:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9558c1ec6000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138223.228132:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2e680 x1869755333194752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138223.228144:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138223.228146:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783138223.228148:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138223.228151:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1783138223.228154:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138223.228157:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9558c1ec2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138223.228177:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955889f2dc00 x1869755333194880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138223.228207:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333194624:0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138223.228299:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783138223.228306:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333194240:0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138223.228361:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333195008:0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138223.228420:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333194496:0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138223.228463:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138223.228468:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333194368:0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138223.228534:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333194240 00000100:00100000:0.0:1783138223.228542:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333194240 00000100:00100000:0.0:1783138223.228604:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783138223.228613:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:3647:x1869755333194240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228685:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:3647:x1869755333194240:12345-0@lo:400:kworker.0 Request processed in 73us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138223.228694:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783138223.228732:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333195008 00000100:00100000:0.0:1783138223.228735:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333195008 00000100:00100000:0.0:1783138223.228762:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333194496 00000100:00100000:0.0:1783138223.228765:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333194496 00000100:00100000:0.0:1783138223.228777:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138223.228782:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333195008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228820:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333195008:12345-0@lo:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138223.228827:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138223.228838:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138223.228844:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333194496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228870:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333194496:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138223.228875:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138223.228893:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333194624 00000100:00100000:0.0:1783138223.228896:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333194624 00000100:00100000:0.0:1783138223.228913:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333194368 00000100:00100000:0.0:1783138223.228915:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333194368 00000100:00100000:0.0:1783138223.228925:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783138223.228930:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333194624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228957:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333194624:12345-0@lo:400:kworker.0 Request processed in 27us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138223.228964:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783138223.228973:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783138223.228978:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869755333194368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.228999:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869755333194368:12345-0@lo:400:kworker.0 Request processed in 21us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138223.229005:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783138223.229040:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333194368:0@lo:400:kworker.0 00010000:00080000:0.0:1783138223.229052:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff955889f2d180 x1869755333194496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138223.229061:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333194496:0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.229093:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333194240:0@lo:400:kworker.0 00010000:00080000:0.0:1783138223.229103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff955889f2f800 x1869755333195008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138223.229110:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333195008:0@lo:400:kworker.0 00000100:00100000:0.0:1783138223.229119:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333194624:0@lo:400:kworker.0 00000100:00100000:2.0:1783138223.229343:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333194752:0@lo:8:kworker.0 00000400:00000100:2.0:1783138223.229372:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333194752 offset 0 length 520: 4 00000100:00100000:2.0:1783138223.229394:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333194880:0@lo:8:kworker.0 00000400:00000100:2.0:1783138223.229411:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333194880 offset 0 length 520: 4 10000000:01000000:3.0:1783138223.290192:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783138223.290199:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9557828c9000 from 13 10000000:01000000:3.0:1783138223.290204:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783138223.290260:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138223.290272:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138223.290294:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138223.290320:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783138223.290389:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138223.290433:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138223.290539:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333195136 00000100:00100000:2.0:1783138223.290547:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333195136 00000100:00100000:2.0:1783138223.290617:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783138223.290697:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+16:22768:x1869755333195136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138223.290722:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138223.290738:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97cd5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138223.290763:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138223.290775:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138223.290784:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2e00, rc 0) 00000100:00100000:2.0:1783138223.290829:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333195136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138223.290836:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783138223.291002:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138223.291016:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138223.291042:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138223.291111:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138223.291139:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138223.291169:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a01da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138223.291386:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333195264 00000100:00100000:2.0:1783138223.291390:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333195264 00000100:00100000:2.0:1783138223.291415:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783138223.291421:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333195264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138223.291530:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333195264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138223.291538:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783138223.291813:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138223.291836:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138223.291873:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138223.291898:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a01da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138223.291933:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333195392 00000100:00100000:2.0:1783138223.291937:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333195392 00000100:00100000:2.0:1783138223.291960:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783138223.291966:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333195392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138223.292061:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333195392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138223.292077:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783138223.292186:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783138223.293512:0:23974:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783138223.293964:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783138223.293990:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138223.294000:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138223.294012:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138223.294022:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783138223.294086:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9558b1cfd000 from 13 10000000:01000000:1.0:1783138223.294090:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783138223.294127:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138223.294135:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138223.294156:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138223.294179:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138223.294231:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138223.294496:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a01da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138223.296249:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333195520 00000100:00100000:3.0:1783138223.296262:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333195520 00000100:00100000:3.0:1783138223.296429:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783138223.296440:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+17:22768:x1869755333195520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138223.296458:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138223.296480:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97ce3 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138223.296511:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138223.296522:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138223.296532:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b7024800, rc 0) 00000100:00100000:3.0:1783138223.296687:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:22768:x1869755333195520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138223.296705:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783138223.296791:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138223.296809:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138223.296819:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138223.296892:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138223.296922:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138223.298673:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a01da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138223.298818:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333195648 00000100:00100000:2.0:1783138223.298827:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333195648 00000100:00100000:2.0:1783138223.298873:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783138223.298882:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:22768:x1869755333195648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138223.299047:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:22768:x1869755333195648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138223.299054:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783138223.299196:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138223.299243:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138223.299304:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138223.299329:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a01da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138223.299419:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333195776 00000100:00100000:2.0:1783138223.299424:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333195776 00000100:00100000:2.0:1783138223.299442:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783138223.299449:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:22768:x1869755333195776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138223.299531:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:22768:x1869755333195776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138223.299538:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783138223.302348:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333195776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783138223.304016:0:23977:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783138223.307783:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783138223.307826:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138223.307839:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138223.307860:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138224.128247:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138224.244865:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138224.244892:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333195904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138224.244966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138224.245030:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333195904 00000100:00100000:0.0:1783138224.245038:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333195904 00000100:00100000:0.0:1783138224.245083:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138224.245092:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333195904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783138224.245139:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138224.245184:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333195904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138224.245304:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138224.245351:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333195904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138224.245501:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138209/real 1783138209] req@ffff9558b17c5180 x1869755333187072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138224 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138224.245521:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9558b17c5180 x1869755333187072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138224.245531:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138209/real 1783138209] req@ffff955889f2f480 x1869755333186816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138224 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138224.245541:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff955889f2f480 x1869755333186816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138224.245573:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578266b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138224.245601:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783138224.245605:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333187072:0@lo:8:kworker.0 00000100:00080000:2.0:1783138224.245610:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138224.245615:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783138224.245617:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333186816:0@lo:8:kworker.0 00000100:00080000:2.0:1783138224.245693:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138224.245697:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783138224.245699:0:38:0:(import.c:65:import_set_state_nolock()) ffff95578266b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138224.245703:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:2.0:1783138224.245707:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783138224.245712:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95578266b800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138224.245730:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955784069500 x1869755333196288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138224.245741:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138224.245744:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783138224.245745:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138224.245748:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:2.0:1783138224.245750:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783138224.245753:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9558b1ced800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783138224.245762:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff955784068e00 x1869755333196416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138224.245776:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138224.245779:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138224.245782:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138224.245790:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138224.245817:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333196672:0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.245856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138224.245879:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138224.245884:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333196032:0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.245912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138224.245944:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333196160:0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.245968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138224.245985:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138224.245990:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333196544:0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.246010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138224.246044:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333196672 00000100:00100000:2.0:1783138224.246049:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333196672 00000100:00100000:2.0:1783138224.246079:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333196544 00000100:00100000:2.0:1783138224.246082:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333196544 00000100:00100000:2.0:1783138224.246095:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138224.246102:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333196672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.246664:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333196672:12345-0@lo:400:kworker.0 Request processed in 560us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138224.246672:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138224.246690:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138224.246697:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333196544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.246732:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333196544:12345-0@lo:400:kworker.0 Request processed in 36us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138224.246739:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138224.246757:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333196032 00000100:00100000:2.0:1783138224.246770:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333196032 00000100:00100000:2.0:1783138224.246801:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783138224.246807:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3645:x1869755333196032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.246838:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:3645:x1869755333196032:12345-0@lo:400:kworker.0 Request processed in 31us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138224.246844:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783138224.246872:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333196160 00000100:00100000:2.0:1783138224.246876:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333196160 00000100:00100000:2.0:1783138224.246898:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783138224.246904:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869755333196160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.246936:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869755333196160:12345-0@lo:400:kworker.0 Request processed in 32us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138224.246942:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1783138224.246983:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95578406aa00 x1869755333196544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138224.246996:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333196544:0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.247021:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333196160:0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.247053:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333196032:0@lo:400:kworker.0 00010000:00080000:2.0:1783138224.247062:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff955784068380 x1869755333196672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138224.247072:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333196672:0@lo:400:kworker.0 00000100:00100000:2.0:1783138224.247092:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333196288:0@lo:8:kworker.0 00000400:00000100:2.0:1783138224.250432:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333196288 offset 0 length 520: 4 00000100:00100000:2.0:1783138224.250508:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333196416:0@lo:8:kworker.0 00000400:00000100:2.0:1783138224.250612:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755333196416 offset 0 length 520: 4 00000100:00100000:2.0:1783138224.250666:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138224.250677:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333196800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138224.250713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138224.263085:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333196800 00000100:00100000:0.0:1783138224.263100:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333196800 00000100:00100000:0.0:1783138224.263173:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783138224.263184:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869755333196800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783138224.263229:0:23513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783138224.263315:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869755333196800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (12600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138224.263333:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783138224.263396:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333196800:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1783138224.759381:0:23505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783138225.141428:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138226.166902:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783138226.361178:0:23528:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783138227.189721:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138228.213270:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783138228.849424:0:24273:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783138228.849428:0:24273:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783138228.849430:0:24273:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783138228.849555:0:24273:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9558a576a800 00000020:01000004:3.0:1783138228.849574:0:24273:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783138228.849590:0:24273:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783138228.849606:0:24273:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9558b71a4d40) 00000020:00000080:3.0:1783138228.849625:0:24273:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783138228.923380:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783138228.924705:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783138228.925660:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783138228.925959:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783138228.926220:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783138228.926500:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783138228.926753:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1783138228.929263:0:24273:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783138228.929514:0:24273:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783138228.929528:0:24273:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783138228.929541:0:24273:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6bc248e9a4e97cf8 00000020:01000004:1.0:1783138228.929548:0:24273:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783138228.929570:0:24273:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783138228.929575:0:24273:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783138228.929581:0:24273:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783138228.929587:0:24273:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783138228.929598:0:24273:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff955781f44d40) 00000020:00000080:1.0:1783138228.929609:0:24273:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1783138228.931597:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783138228.935155:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783138228.935165:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783138228.940192:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783138228.940205:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783138228.951044:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1783138228.952072:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783138228.960435:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783138228.960704:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783138228.960712:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783138228.963542:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783138228.963559:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783138228.997967:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138228.998216:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783138228.998223:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783138228.999994:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783138229.000008:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783138229.000853:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783138229.000862:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783138229.003357:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138229.003589:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783138229.003597:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783138229.004504:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783138229.004511:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783138229.040024:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138229.040262:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783138229.040276:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783138229.041659:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783138229.041671:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783138229.042123:0:24273:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783138229.042156:0:24273:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783138229.042162:0:24273:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783138229.061110:0:24273:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783138229.061152:0:24273:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1783138229.061156:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783138229.061158:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783138229.061160:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138229.061162:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138229.061163:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138229.061165:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138229.061166:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783138229.061168:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138229.061170:0:24273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783138229.061173:0:24273:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1783138229.061176:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783138229.061177:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783138229.061178:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138229.061179:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138229.061180:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138229.061182:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138229.061183:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783138229.061184:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138229.061184:0:24273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783138229.061212:0:24273:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783138229.061238:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333196928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783138229.061308:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.061357:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138229.061429:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333196928 00000100:00100000:0.0:1783138229.061437:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333196928 00000100:00100000:0.0:1783138229.061508:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783138229.061519:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6953850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:24273:x1869755333196928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783138229.061552:0:22766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783138229.061555:0:22766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783138229.061559:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783138229.061916:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6953850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:24273:x1869755333196928:12345-0@lo:253:mount.lustre.0 Request processed in 398us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138229.061933:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783138229.062013:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333196928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783138229.062025:0:24273:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783138229.062027:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783138229.062029:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783138229.062030:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138229.062031:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138229.062032:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138229.062033:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138229.062034:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783138229.062036:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138229.062037:0:24273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783138229.062057:0:24273:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9558a576a800 from lustre-OST0000 10000000:01000000:3.0:1783138229.062084:0:24273:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783138229.062086:0:24273:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783138229.062095:0:24273:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9558a6133380 local copy 00010000:00010000:3.0:1783138229.062108:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138229.062202:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138229.062233:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.062267:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783138229.062398:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333197056 00000100:00100000:0.0:1783138229.062403:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333197056 00000100:00100000:0.0:1783138229.062436:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783138229.062443:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6951450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:24273:x1869755333197056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138229.062525:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6951450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:24273:x1869755333197056:12345-0@lo:501:mount.lustre.0 Request processed in 82us (290us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783138229.062531:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783138229.062598:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197056:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783138229.062610:0:24273:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783138229.062659:0:24273:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783138229.062666:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.062687:0:24273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138229.062715:0:24273:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9558a576a800 10000000:01000000:1.0:1783138229.062720:0:24273:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783138229.062726:0:24273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783138229.062728:0:24273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138229.062733:0:24273:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783138229.062736:0:24273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783138229.062758:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b800/0x6bc248e9a4e97d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.062767:0:24273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302b800/0x6bc248e9a4e97d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.062776:0:24273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302b800/0x6bc248e9a4e97d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138229.062790:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138229.062818:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138229.062835:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a4900 going to sleep for 11 seconds 00000100:00100000:3.0:1783138229.062891:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333197184 00000100:00100000:3.0:1783138229.062895:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333197184 00000100:00100000:3.0:1783138229.062937:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783138229.062945:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6952450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+18:24273:x1869755333197184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138229.062954:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138229.062966:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b7024e00/0x6bc248e9a4e97d0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97d06 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.062999:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b7024e00/0x6bc248e9a4e97d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d06 expref: 19 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.063009:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b7024e00/0x6bc248e9a4e97d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d06 expref: 19 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.063018:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b7024e00, rc 0) 00000100:00100000:3.0:1783138229.063040:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6952450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197184:12345-0@lo:101:mount.lustre.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138229.063045:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783138229.063192:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138229.063201:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302b800/0x6bc248e9a4e97d06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d0d expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.063207:0:24273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302b800/0x6bc248e9a4e97d06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97d0d expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138229.064093:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1783138229.064857:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138229.066370:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1783138229.066424:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1783138229.066434:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1783138229.066442:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1783138229.066449:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1783138229.066456:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1783138229.066482:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1783138229.066495:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1783138229.066509:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1783138229.066522:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1783138229.066536:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1783138229.066556:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1783138229.066580:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1783138229.066587:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1783138229.070715:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138229.070810:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138229.070863:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138229.070963:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333197312 00000100:00100000:2.0:1783138229.070971:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333197312 00000100:00100000:2.0:1783138229.071026:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783138229.071036:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6952850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138229.071265:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6952850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197312:12345-0@lo:501:mount.lustre.0 Request processed in 229us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.071274:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783138229.071478:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138229.071530:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138229.071571:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138229.071599:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138229.071664:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333197440 00000100:00100000:3.0:1783138229.071668:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333197440 00000100:00100000:3.0:1783138229.071686:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783138229.071691:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138229.072838:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197440:12345-0@lo:503:mount.lustre.0 Request processed in 1141us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138229.072849:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783138229.072961:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197440:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783138229.073375:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138229.073490:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138229.073532:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138229.073608:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138229.073853:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333197568 00000100:00100000:1.0:1783138229.073860:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333197568 00000100:00100000:0.0:1783138229.074031:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783138229.074041:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138229.074420:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197568:12345-0@lo:502:mount.lustre.0 Request processed in 379us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138229.074429:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783138229.074511:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138229.074996:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1783138229.075031:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1783138229.075046:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1783138229.075059:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1783138229.075073:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1783138229.075086:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1783138229.075098:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1783138229.075111:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1783138229.075123:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1783138229.075135:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1783138229.075148:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1783138229.075159:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1783138229.075202:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138229.075261:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138229.075364:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783138229.075418:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333197696 00000100:00100000:3.0:1783138229.075426:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333197696 00000100:00100000:3.0:1783138229.075485:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783138229.075493:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138229.075765:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197696:12345-0@lo:502:mount.lustre.0 Request processed in 272us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138229.075774:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783138229.075867:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138229.075919:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1783138229.075928:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1783138229.076755:0:24290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783138229.076763:0:24290:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783138229.076773:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.076775:0:24290:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783138229.076780:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783138229.076793:0:24290:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9558b71a3380) 00000020:00000080:3.0:1783138229.076834:0:24290:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783138229.076841:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783138229.076940:0:24290:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9558a576a800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783138229.076951:0:24290:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783138229.076958:0:24290:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6bc248e9a4e97d1b 00010000:00010000:3.0:1783138229.083413:0:24290:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1783138229.084147:0:24290:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1783138229.086171:0:24290:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1783138229.089604:0:24290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783138229.089619:0:24290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138229.089624:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138229.089649:0:24290:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783138229.089654:0:24290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783138229.089658:0:24290:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1783138229.089659:0:24290:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783138229.089661:0:24290:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783138229.089662:0:24290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783138229.089665:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138229.089666:0:24290:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783138229.089668:0:24290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138229.089679:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138229.089680:0:24290:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783138229.089684:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783138229.089686:0:24290:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783138229.089688:0:24290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138229.089691:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138229.089692:0:24290:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783138229.089694:0:24290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138229.089696:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138229.089697:0:24290:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783138229.089700:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783138229.089734:0:24290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138229.089737:0:24290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138229.089738:0:24290:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783138229.089741:0:24290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1783138229.089942:0:24273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783138229.089993:0:24273:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783138229.090018:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b800/0x6bc248e9a4e97d06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d0d expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.090032:0:24273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302b800/0x6bc248e9a4e97d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d0d expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138229.090040:0:24273:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9558a576a800 from 1 10000000:01000000:2.0:1783138229.090043:0:24273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138229.090082:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.090091:0:24273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.090102:0:24273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138229.090135:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138229.090204:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138229.090253:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883ecf240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138229.090709:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333197824 00000100:00100000:1.0:1783138229.090719:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333197824 00000100:00100000:1.0:1783138229.090762:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783138229.090771:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:24273:x1869755333197824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138229.090784:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138229.090797:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97d22 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.090822:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.090831:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.090841:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302b000, rc 0) 00000100:00100000:1.0:1783138229.090892:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333197824:12345-0@lo:101:mount.lustre.0 Request processed in 121us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138229.090911:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783138229.090941:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138229.090958:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.090967:0:24273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783138229.092662:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1783138229.093070:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138229.093231:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1783138229.093254:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1783138229.093267:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1783138229.093281:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1783138229.093293:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1783138229.093301:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1783138229.093308:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1783138229.093327:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1783138229.093341:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1783138229.093353:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1783138229.093365:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1783138229.093381:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1783138229.093386:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1783138229.093469:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138229.093534:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138229.093590:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5b840 going to sleep for 11 seconds 00000100:00100000:1.0:1783138229.093613:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333197952 00000100:00100000:1.0:1783138229.093622:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333197952 00000100:00100000:1.0:1783138229.093711:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783138229.093722:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333197952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138229.094227:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333197952:12345-0@lo:501:mount.lustre.0 Request processed in 495us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138229.094234:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783138229.094486:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333197952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138229.094530:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138229.094573:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138229.094668:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883ecfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138229.094728:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333198080 00000100:00100000:1.0:1783138229.094797:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333198080 00000100:00100000:1.0:1783138229.094876:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783138229.094884:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333198080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138229.094982:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333198080:12345-0@lo:503:mount.lustre.0 Request processed in 98us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138229.094989:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783138229.095054:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783138229.095501:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783138229.095580:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138229.095618:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.097297:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782a0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138229.098579:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333198208 00000100:00100000:2.0:1783138229.098589:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333198208 00000100:00100000:2.0:1783138229.098662:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783138229.098673:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333198208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138229.098834:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333198208:12345-0@lo:502:mount.lustre.0 Request processed in 162us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.098842:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783138229.099104:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138229.099327:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1783138229.099363:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1783138229.099377:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1783138229.099392:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1783138229.099423:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1783138229.099436:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1783138229.099448:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1783138229.099472:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1783138229.099485:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1783138229.099498:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1783138229.099511:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1783138229.099549:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138229.099602:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.099660:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782a0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138229.099729:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333198336 00000100:00100000:2.0:1783138229.099735:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333198336 00000100:00100000:2.0:1783138229.099762:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783138229.099769:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333198336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138229.099852:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333198336:12345-0@lo:502:mount.lustre.0 Request processed in 83us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.099858:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783138229.099985:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138229.100023:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1783138229.100032:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783138229.104571:0:24294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138229.104584:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.104586:0:24294:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783138229.104594:0:24294:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9558a576a800 00000020:00000080:3.0:1783138229.104596:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138229.104604:0:24294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138229.104607:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.104608:0:24294:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783138229.104611:0:24294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138229.104613:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.104615:0:24294:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783138229.104618:0:24294:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9558a576a800 00000020:00000080:3.0:1783138229.104620:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138229.104882:0:24294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138229.104887:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.104889:0:24294:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783138229.104891:0:24294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138229.104894:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.104895:0:24294:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138229.104899:0:24294:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9558a576a800 00000020:00000080:3.0:1783138229.104901:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138229.107749:0:24294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138229.107765:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.107767:0:24294:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138229.107772:0:24294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138229.107776:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.107777:0:24294:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783138229.107789:0:24294:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9558a576a800 00000020:00000080:3.0:1783138229.107792:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138229.107872:0:24294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138229.107876:0:24294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138229.107878:0:24294:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783138229.107881:0:24294:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1783138229.108181:0:24273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783138229.108217:0:24273:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138229.108245:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.108259:0:24273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138229.108313:0:24273:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783138229.108316:0:24273:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9558a576a800 10000000:01000000:1.0:1783138229.108319:0:24273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9558a576a800 10000000:01000000:1.0:1783138229.108323:0:24273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138229.108335:0:24273:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9558a576a800 from 1 10000000:01000000:1.0:1783138229.108338:0:24273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783138229.108371:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302be00/0x6bc248e9a4e97d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.108379:0:24273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302be00/0x6bc248e9a4e97d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138229.108391:0:24273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302be00/0x6bc248e9a4e97d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138229.108415:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138229.108487:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138229.108528:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138229.108698:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333198464 00000100:00100000:2.0:1783138229.108705:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333198464 00000100:00100000:2.0:1783138229.108823:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783138229.108833:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:24273:x1869755333198464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138229.108854:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138229.108867:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2800/0x6bc248e9a4e97d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97d30 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.108893:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2800/0x6bc248e9a4e97d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d30 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.108903:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2800/0x6bc248e9a4e97d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d30 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.108911:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2800, rc 0) 00000100:00100000:2.0:1783138229.109031:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198464:12345-0@lo:101:mount.lustre.0 Request processed in 199us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.109038:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783138229.109106:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138229.109120:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302be00/0x6bc248e9a4e97d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d37 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.109129:0:24273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302be00/0x6bc248e9a4e97d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97d37 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138229.117127:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1783138229.117451:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138229.117686:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1783138229.117728:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1783138229.117745:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1783138229.117758:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1783138229.117771:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1783138229.117783:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1783138229.117795:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1783138229.117809:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1783138229.117823:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1783138229.117836:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1783138229.117849:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1783138229.117861:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1783138229.117873:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1783138229.117886:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1783138229.117899:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1783138229.117912:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1783138229.117936:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1783138229.118040:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1783138229.118055:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1783138229.118066:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1783138229.118077:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1783138229.118090:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1783138229.118103:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1783138229.118117:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1783138229.118130:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1783138229.118142:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1783138229.118155:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1783138229.118166:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1783138229.118178:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1783138229.118193:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1783138229.118206:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1783138229.118218:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1783138229.118232:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1783138229.118257:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1783138229.118273:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1783138229.118286:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1783138229.118299:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1783138229.118311:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1783138229.118324:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1783138229.118337:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1783138229.118349:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1783138229.118360:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1783138229.118373:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1783138229.118387:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1783138229.118402:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1783138229.118413:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1783138229.118426:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1783138229.118439:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1783138229.118582:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1783138229.118607:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1783138229.118625:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1783138229.118662:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1783138229.118770:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138229.118842:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.118904:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782a0c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783138229.120080:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333198592 00000100:00100000:0.0:1783138229.120098:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333198592 00000100:00100000:0.0:1783138229.120164:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783138229.120174:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138229.120325:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198592:12345-0@lo:501:mount.lustre.0 Request processed in 151us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138229.120333:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783138229.122146:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138229.122203:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138229.122269:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.122312:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782a0c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783138229.123183:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333198720 00000100:00100000:0.0:1783138229.123192:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333198720 00000100:00100000:0.0:1783138229.123252:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783138229.123262:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138229.123387:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198720:12345-0@lo:503:mount.lustre.0 Request processed in 126us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138229.123396:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783138229.125244:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783138229.125834:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783138229.125934:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138229.128612:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.128677:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782a0cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138229.128866:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333198848 00000100:00100000:1.0:1783138229.128877:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333198848 00000100:00100000:1.0:1783138229.128944:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783138229.128967:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138229.129114:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198848:12345-0@lo:502:mount.lustre.0 Request processed in 149us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138229.129122:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783138229.129322:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138229.129586:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783138229.129621:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783138229.129674:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783138229.129691:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783138229.129705:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783138229.129719:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783138229.129733:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783138229.129747:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783138229.129760:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783138229.129775:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783138229.129790:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783138229.129830:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783138229.129855:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783138229.129869:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783138229.129881:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783138229.129893:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1783138229.129907:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1783138229.129920:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1783138229.129949:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1783138229.129975:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1783138229.129989:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1783138229.130001:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1783138229.130015:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1783138229.130031:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1783138229.130044:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1783138229.130057:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1783138229.130070:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1783138229.130099:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1783138229.130115:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1783138229.130128:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1783138229.130140:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1783138229.130151:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1783138229.130162:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1783138229.130173:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1783138229.130185:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1783138229.130199:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1783138229.130212:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1783138229.130226:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1783138229.130238:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1783138229.130249:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1783138229.130262:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1783138229.130276:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1783138229.130289:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1783138229.130317:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1783138229.130339:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1783138229.130352:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1783138229.130364:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1783138229.130375:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1783138229.130424:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138229.130497:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.130540:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333198976 00000100:00100000:3.0:1783138229.130546:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333198976 00000100:00100000:3.0:1783138229.130585:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783138229.130594:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138229.130721:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333198976:12345-0@lo:502:mount.lustre.0 Request processed in 128us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138229.130730:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783138229.130778:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782a0cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138229.130796:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333198976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138229.130938:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1783138229.130959:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1783138229.130979:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333199104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138229.131013:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.131029:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782a0cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138229.131251:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333199104 00000100:00100000:1.0:1783138229.131255:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333199104 00000100:00100000:1.0:1783138229.131289:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783138229.131297:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333199104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138229.131371:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333199104:12345-0@lo:502:mount.lustre.0 Request processed in 74us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138229.131377:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783138229.131468:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333199104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138229.131506:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1783138229.131514:0:24273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783138229.144551:0:24299:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783138229.144571:0:24299:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff955783a119c0) 00000020:00000080:0.0:1783138229.144599:0:24299:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1783138229.144839:0:24299:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9558a576a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783138229.144844:0:24299:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9558a576a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783138229.144846:0:24299:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9558a576a800 3 00010000:00080000:0.0:1783138229.144877:0:24299:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9558a559a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1783138229.147541:0:24299:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1783138229.147684:0:24299:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783138229.147735:0:24299:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783138229.147749:0:24299:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6bc248e9a4e97d45 00000100:00080000:0.0:1783138229.147762:0:24299:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138229.147770:0:24299:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9558a559a000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138229.147811:0:24299:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9557838ff800 x1869755333199232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138229.147848:0:24299:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783138229.148001:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869755333199232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138229.148073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783138229.148171:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138229.148177:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138229.148180:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138229.148183:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138229.148205:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138229.148207:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138229.148210:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138229.148212:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138229.148239:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869755333199488:0@lo:400:kworker.0 00000100:00100000:2.0:1783138229.148275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138229.148296:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783138229.148301:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333199360:0@lo:400:kworker.0 00000100:00100000:2.0:1783138229.148329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138229.148361:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578406a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333199616:0@lo:400:kworker.0 00000100:00100000:2.0:1783138229.148384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138229.148397:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138229.148401:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333199744:0@lo:400:kworker.0 00000100:00100000:2.0:1783138229.148433:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138229.148477:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333199232 00000100:00100000:2.0:1783138229.148485:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333199232 00000100:00100000:2.0:1783138229.148511:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333199488 00000100:00100000:2.0:1783138229.148514:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333199488 00000100:00100000:0.0:1783138229.148522:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333199744 00000100:00100000:0.0:1783138229.148525:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333199744 00000100:00100000:2.0:1783138229.148542:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138229.148551:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869755333199488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138229.148556:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783138229.148563:0:22773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783138229.148616:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869755333199488:12345-0@lo:400:kworker.0 Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.148623:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138229.148661:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138229.148667:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333199744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138229.148701:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333199744:12345-0@lo:400:kworker.0 Request processed in 34us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.148707:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138229.148719:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138229.148724:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333199232:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783138229.148726:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff955784068000 x1869755333199744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783138229.148744:0:22771:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 698 last 0 00000100:00100000:0.0:1783138229.148752:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333199744:0@lo:400:kworker.0 00000020:00000080:2.0:1783138229.148779:0:22771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6bc248e9a4e97d4c 00000004:00100000:2.0:1783138229.148795:0:22771:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783138229.148826:0:22771:0:(import.c:65:import_set_state_nolock()) ffff955782707000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138229.148863:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1869755333199232:12345-0@lo:38:llog_process_th.0 Request processed in 137us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.148874:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138229.148895:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333199360 00000100:00100000:2.0:1783138229.148899:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333199360 00000100:00100000:2.0:1783138229.148922:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333199616 00000100:00100000:2.0:1783138229.148924:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333199616 00000100:00100000:2.0:1783138229.149067:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783138229.149074:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333199360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138229.149107:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333199360:12345-0@lo:400:kworker.0 Request processed in 34us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.149112:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783138229.149123:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783138229.149128:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333199616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138229.149195:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333199616:12345-0@lo:400:kworker.0 Request processed in 67us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.149201:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783138229.149384:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333199360:0@lo:400:kworker.0 00010000:00080000:2.0:1783138229.149397:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95578406ad80 x1869755333199488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138229.149405:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869755333199488:0@lo:400:kworker.0 00010000:00080000:2.0:1783138229.149431:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9557838ff800 x1869755333199232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138229.149449:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783138229.149456:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1783138229.149475:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783138229.149480:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783138229.149483:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558a559a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783138229.149490:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869755333199232:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783138229.149550:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578406a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333199616:0@lo:400:kworker.0 00000020:01000004:3.0:1783138229.150869:0:24299:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783138229.150887:0:24299:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9558b7000000) 00000020:00000080:3.0:1783138229.150917:0:24299:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1783138229.151215:0:24299:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9558a576a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783138229.151221:0:24299:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9558a576a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783138229.151224:0:24299:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9558a576a800 3 00010000:00080000:3.0:1783138229.151258:0:24299:0:(ldlm_lib.c:102:import_set_conn()) imp ffff955784c81000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1783138229.155095:0:24299:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1783138229.155218:0:24299:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1783138229.155273:0:24299:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783138229.155286:0:24299:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6bc248e9a4e97d5a 00000100:00080000:0.0:1783138229.155299:0:24299:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138229.155306:0:24299:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff955784c81000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138229.156062:0:24299:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9557838fed80 x1869755333199872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138229.156095:0:24299:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783138229.156323:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869755333199872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138229.156411:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783138229.156484:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138229.156489:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138229.156492:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138229.156495:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138229.156498:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138229.156502:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138229.156504:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138229.156507:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138229.156608:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333199872 00000100:00100000:2.0:1783138229.156617:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333199872 00000100:00100000:2.0:1783138229.156680:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138229.156689:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333199872:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783138229.156718:0:22771:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 698 last 0 00000020:00000080:2.0:1783138229.156754:0:22771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6bc248e9a4e97d61 00000004:00100000:2.0:1783138229.156781:0:22771:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783138229.156819:0:22771:0:(import.c:65:import_set_state_nolock()) ffff955782704000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138229.156870:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1869755333199872:12345-0@lo:38:llog_process_th.0 Request processed in 180us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.156877:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783138229.156916:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9557838fed80 x1869755333199872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138229.156927:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783138229.156934:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1783138229.156942:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783138229.156947:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783138229.156949:0:3644:0:(import.c:65:import_set_state_nolock()) ffff955784c81000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000040:00080000:1.0:1783138229.158275:0:24299:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:2.0:1783138229.158571:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869755333199872:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1783138229.158618:0:24273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783138229.158670:0:24273:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783138229.158695:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302be00/0x6bc248e9a4e97d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d37 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.158707:0:24273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302be00/0x6bc248e9a4e97d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d37 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783138229.158771:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783138229.158775:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138229.158776:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138229.158777:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138229.158778:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138229.158780:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138229.158782:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138229.158784:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138229.158791:0:24273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783138229.158796:0:24273:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783138229.158799:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138229.158800:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138229.158801:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138229.158802:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138229.158803:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138229.158804:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138229.158805:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138229.158806:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138229.158806:0:24273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783138229.158840:0:24273:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783138229.158864:0:24273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333200000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138229.158944:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138229.159375:0:24273:0:(client.c:2701:ptlrpc_set_wait()) set ffff955883ecff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138229.164127:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333200000 00000100:00100000:1.0:1783138229.164141:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333200000 00000100:00100000:1.0:1783138229.164191:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783138229.164201:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333200000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783138229.164336:0:22766:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783138229.164352:0:22766:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783138229.165865:0:22766:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783138229.165878:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783138229.166597:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:24273:x1869755333200000:12345-0@lo:253:mount.lustre.0 Request processed in 2393us (7648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138229.166609:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783138229.166612:0:24273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:24273:1869755333200000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783138229.166625:0:24273:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783138229.166646:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783138229.166648:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138229.166649:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138229.166651:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138229.166652:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138229.166653:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138229.166655:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138229.166656:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138229.166658:0:24273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783138229.166672:0:24273:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1783138229.168530:0:24273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 20000000:01000000:0.0:1783138229.168684:0:22787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783138229.168690:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783138229.168715:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.168770:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 20 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.168777:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.168785:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.168827:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.168841:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 20 pid: 22764 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138229.168858:0:22787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333200128:0@lo:104: 00000100:00100000:0.0:1783138229.168938:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783138229.169000:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 20 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.169010:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 20 pid: 22765 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138229.169018:0:22787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333200256:0@lo:104: 00000100:00100000:0.0:1783138229.169043:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138229.169056:0:22787:0:(client.c:2701:ptlrpc_set_wait()) set ffff955888b79c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138229.169412:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783138229.169429:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333200128 00000100:00100000:3.0:1783138229.169436:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333200128 00000100:00100000:3.0:1783138229.169480:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333200256 00000100:00100000:3.0:1783138229.169484:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333200256 00000100:00100000:3.0:1783138229.169500:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138229.169508:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+4:22787:x1869755333200128:12345-0@lo:104: 00010000:00010000:3.0:1783138229.169521:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169594:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783138229.169601:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+4:22787:x1869755333200128:12345-0@lo:104: Request processed in 93us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138229.169608:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138229.169648:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783138229.169656:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bbf6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:22787:x1869755333200256:12345-0@lo:104: 00010000:00010000:3.0:1783138229.169664:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169695:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783138229.169700:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bbf6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:22787:x1869755333200256:12345-0@lo:104: Request processed in 46us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138229.169706:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783138229.169744:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138229.169755:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169762:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302b200 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:3.0:1783138229.169765:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169774:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138229.169781:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138229.169786:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783138229.169816:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169822:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138229.169845:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169851:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff95588302b200/0x6bc248e9a4e97cb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cc0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169861:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783138229.169862:0:22787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333200128:0@lo:104: 00010000:00010000:3.0:1783138229.169864:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169869:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302a800 already unused, calling callback (ffffffffc128bc20) 00000100:00100000:0.0:1783138229.169870:0:22787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333200256:0@lo:104: 10000000:00010000:3.0:1783138229.169872:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169886:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138229.169892:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.169893:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138229.169898:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783138229.169910:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169916:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138229.169932:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.169939:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff95588302a800/0x6bc248e9a4e97cab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cb2 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138229.170050:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138229.170052:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138229.170053:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138229.170060:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138229.170071:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333200384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138229.170100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.170129:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783138229.170136:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333200512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138229.170157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138229.170495:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333200384 00000100:00100000:0.0:1783138229.170501:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333200384 00010000:00010000:0.0:1783138229.170521:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 21 pid: 22764 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138229.170546:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333200512 00000100:00100000:0.0:1783138229.170549:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333200512 00000100:00100000:2.0:1783138229.170558:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1783138229.170559:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 22 pid: 22765 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138229.170564:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:3647:x1869755333200384:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138229.170570:0:22757:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1783138229.170575:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783138229.170575:0:22757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1783138229.170580:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 22 pid: 22764 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170600:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 22 pid: 22764 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170612:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834dee00/0x6bc248e9a4e97cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97cb9 expref: 22 pid: 22764 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170623:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138229.170675:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3647:x1869755333200384:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.170682:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138229.170697:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138229.170702:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ba858c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:3647:x1869755333200512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138229.170710:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138229.170715:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 20 pid: 22765 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170724:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 20 pid: 22765 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170733:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b6fa2400/0x6bc248e9a4e97cb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97cab expref: 20 pid: 22765 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170744:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170752:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783138229.170764:0:22758:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009479714s 00010000:00010000:2.0:1783138229.170774:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170781:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170787:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170794:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170799:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138229.170803:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170810:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170829:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138229.170838:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138229.170861:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ba858c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:3647:x1869755333200512:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (703us total) trans 0 rc 0/0 00010000:00010000:0.0:1783138229.170864:0:22787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138229.170868:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783138229.170871:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138229.170877:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9557834df200/0x6bc248e9a4e97d68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138229.171150:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333200512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138229.171159:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333200384:0@lo:103:ldlm_bl.0 00002000:00080000:2.0:1783138229.175376:0:24273:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783138229.175384:0:24273:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783138229.175422:0:24273:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783138229.175470:0:24273:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783138229.175487:0:24273:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783138229.175505:0:24273:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783138229.179440:0:24273:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783138229.179775:0:24273:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783138229.241283:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138229.365550:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333200640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783138229.365645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138229.365698:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783138229.365706:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333200768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783138229.365731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138229.366340:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333200640 00000100:00100000:2.0:1783138229.366351:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333200640 00000100:00100000:2.0:1783138229.366394:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333200768 00000100:00100000:2.0:1783138229.366398:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333200768 00000100:00100000:2.0:1783138229.366413:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138229.366422:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333200640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138229.366522:0:23513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138229.366672:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333200640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 249us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.366679:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138229.366698:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783138229.366704:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333200768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783138229.366720:0:23513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783138229.366750:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333200768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138229.366755:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783138229.366809:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333200768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138229.366825:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333200640:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1783138230.021120:0:24355:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138230.021573:0:24355:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783138230.269660:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783138231.170486:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783138231.170495:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9557828c9000 from 13 10000000:01000000:2.0:1783138231.170501:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783138231.170555:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.170583:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.170596:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138231.170625:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333200896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138231.170714:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138231.170773:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333200896 00000100:00100000:2.0:1783138231.170781:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333200896 00000100:00100000:2.0:1783138231.170831:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783138231.170840:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+19:22768:x1869755333200896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138231.170853:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138231.170866:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97d6f expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.170888:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.170898:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.170908:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa3800, rc 0) 00000100:00100000:2.0:1783138231.170942:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:22768:x1869755333200896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138231.170949:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783138231.170998:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff955784d4ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138231.171030:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333200896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138231.176247:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.176274:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138231.176719:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333201024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783138231.176798:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138231.176843:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333201024 00000100:00100000:2.0:1783138231.176850:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333201024 00000100:00100000:2.0:1783138231.177150:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783138231.177162:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:22768:x1869755333201024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138231.177188:0:22766:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138231.177207:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138231.177210:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1783138231.177301:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:22768:x1869755333201024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138231.177309:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783138231.177351:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff955784d4ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138231.177374:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333201024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783138231.177444:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783138231.177452:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.177462:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138231.177482:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783138231.177485:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9558b1cfd000 from 13 10000000:01000000:2.0:1783138231.177487:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783138231.177515:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.177524:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.177534:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138231.177548:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333201152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138231.177575:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138231.177601:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333201152 00000100:00100000:2.0:1783138231.177605:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333201152 00000100:00100000:2.0:1783138231.177657:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783138231.177664:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:22768:x1869755333201152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138231.177672:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138231.177684:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97d7d expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.177703:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 21 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.177713:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 21 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.177732:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2a00, rc 0) 00000100:00100000:2.0:1783138231.177756:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333201152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138231.177762:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783138231.177785:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b4b4b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783138231.177797:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333201152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138231.177807:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.177815:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138231.177850:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333201280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783138231.177879:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138231.177896:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333201280 00000100:00100000:2.0:1783138231.177899:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333201280 00000100:00100000:2.0:1783138231.177917:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783138231.177923:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333201280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138231.177932:0:22765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138231.177943:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138231.177946:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1783138231.177997:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333201280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 74us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138231.178004:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783138231.178023:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b4b4b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783138231.178034:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333201280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783138231.178077:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783138231.178082:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138231.178089:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138231.284973:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783138231.670935:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783138232.308846:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138233.333152:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138234.362493:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783138234.484922:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138234.484930:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138234.484933:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138234.484936:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138234.484960:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138234.484964:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138234.484966:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138234.484969:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138234.485012:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333201408:0@lo:400:kworker.0 00000100:00100000:2.0:1783138234.485083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138234.485124:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333201920:0@lo:400:kworker.0 00000100:00100000:2.0:1783138234.485301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138234.485378:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783138234.485386:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333201536:0@lo:400:kworker.0 00000100:00100000:2.0:1783138234.485412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138234.485445:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333202048:0@lo:400:kworker.0 00000100:00100000:2.0:1783138234.485467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138234.488259:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333201536 00000100:00100000:1.0:1783138234.488278:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333201536 00000100:00100000:0.0:1783138234.488848:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333201792:0@lo:400:kworker.0 00000100:00100000:0.0:1783138234.488922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138234.488956:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333202304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138234.488988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138234.489004:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783138234.489011:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333201664:0@lo:400:kworker.0 00000100:00100000:0.0:1783138234.489043:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333201408 00000100:00100000:0.0:1783138234.489048:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333201408 00000100:00100000:0.0:1783138234.489077:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783138234.489085:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3647:x1869755333201408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138234.489216:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3647:x1869755333201408:12345-0@lo:400:kworker.0 Request processed in 130us (4132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138234.489224:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783138234.489263:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333201792 00000100:00100000:0.0:1783138234.489267:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333201792 00000100:00100000:1.0:1783138234.489300:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783138234.489313:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333201536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138234.489355:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333201536:12345-0@lo:400:kworker.0 Request processed in 46us (3942us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138234.489456:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333202304 00000100:00100000:2.0:1783138234.489461:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333202304 00000100:00100000:3.0:1783138234.489507:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333201920 00000100:00100000:3.0:1783138234.489513:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333201920 00000100:00100000:3.0:1783138234.489548:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333202048 00000100:00100000:3.0:1783138234.489551:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333202048 00000100:00100000:3.0:1783138234.489579:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138234.489586:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333201920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138234.489625:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333201920:12345-0@lo:400:kworker.0 Request processed in 40us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138234.489646:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138234.489660:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783138234.489666:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333202048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138234.489695:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333202048:12345-0@lo:400:kworker.0 Request processed in 30us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138234.489778:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138234.489861:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783138234.489870:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1869755333201792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138234.489906:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1869755333201792:12345-0@lo:400:kworker.0 Request processed in 38us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138234.489912:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783138234.489935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138234.489969:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869755333202176:0@lo:400:kworker.0 00000100:00100000:0.0:1783138234.489997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138234.490033:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333201792:0@lo:400:kworker.0 00000100:00100000:3.0:1783138234.490113:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333201664 00000100:00100000:3.0:1783138234.490118:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333201664 00000100:00100000:3.0:1783138234.490148:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333202176 00000100:00100000:3.0:1783138234.490151:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333202176 00000100:00100000:3.0:1783138234.490170:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783138234.490176:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333201664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138234.490211:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333201664:12345-0@lo:400:kworker.0 Request processed in 34us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138234.490217:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783138234.490228:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783138234.490244:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869755333202176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138234.490272:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869755333202176:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138234.490278:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1783138234.490358:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558b7177800 x1869755333201664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138234.490380:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333201664:0@lo:400:kworker.0 00010000:00080000:0.0:1783138234.490391:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558b7174a80 x1869755333202176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138234.490405:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869755333202176:0@lo:400:kworker.0 00000100:00100000:1.0:1783138234.490550:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783138234.490580:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783138234.490591:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333202432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138234.490623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783138234.490693:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783138234.490697:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138234.490802:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333202432 00000100:00100000:0.0:1783138234.490806:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333202432 00000100:00100000:0.0:1783138234.490832:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783138234.490837:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333202432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783138234.490868:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783138234.490906:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333202432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138234.490913:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783138234.490950:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333202432:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1783138234.491064:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558b7176680 x1869755333202048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138234.491073:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333202048:0@lo:400:kworker.0 00000100:00100000:3.0:1783138234.491085:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333201408:0@lo:400:kworker.0 00010000:00080000:3.0:1783138234.491099:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558b7177480 x1869755333201920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138234.491106:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333201920:0@lo:400:kworker.0 00000100:00100000:3.0:1783138234.491125:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333201536:0@lo:400:kworker.0 00000100:00100000:2.0:1783138234.496448:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783138234.496482:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333202304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783138234.496526:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783138234.496642:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333202304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (7639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138234.496650:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783138234.500079:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333202304:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783138235.381669:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783138236.011587:0:24646:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783138236.407033:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783138236.597380:0:23528:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1783138237.167148:0:24698:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783138237.167775:0:24698:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783138237.433418:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783138238.345261:0:24749:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783138238.345543:0:24749:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783138238.389099:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138223/real 1783138223] req@ffff955889f2e680 x1869755333194752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138238 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138238.389132:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff955889f2e680 x1869755333194752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138238 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138238.389142:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138223/real 1783138223] req@ffff955889f2dc00 x1869755333194880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138238 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138238.389152:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff955889f2dc00 x1869755333194880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138238 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783138238.389172:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138238.389189:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783138238.389193:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333194752:0@lo:8:kworker.0 00000100:00080000:0.0:1783138238.389206:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138238.389212:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783138238.389215:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333194880:0@lo:8:kworker.0 00000100:00080000:0.0:1783138238.389291:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138238.389295:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138238.389310:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138238.389313:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138238.389329:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138238.389333:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783138238.389335:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138238.389340:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 692 00000100:00080000:0.0:1783138238.389344:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783138238.389351:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9558c1ec6000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138238.389370:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9557838fdc00 x1869755333203072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138238.389383:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138238.389386:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783138238.389387:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138238.389390:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 692 00000100:00080000:0.0:1783138238.389392:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783138238.389395:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9558c1ec2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783138238.389406:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9557838fd500 x1869755333203200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138238.389440:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333202944:0@lo:400:kworker.0 00000100:00100000:0.0:1783138238.389456:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333202560:0@lo:400:kworker.0 00000100:00100000:1.0:1783138238.389501:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333202688:0@lo:400:kworker.0 00000100:00100000:0.0:1783138238.389930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138238.389982:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869755333203328:0@lo:400:kworker.0 00000100:00100000:0.0:1783138238.390011:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138238.390055:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333203072:0@lo:8:kworker.0 00000100:00100000:0.0:1783138238.390087:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138238.390095:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333202816:0@lo:400:kworker.0 00000100:00100000:0.0:1783138238.390105:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333203200:0@lo:8:kworker.0 00000100:00100000:2.0:1783138238.390123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138238.390123:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138238.390139:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869755333203584:0@lo:400:kworker.0 00000100:00100000:2.0:1783138238.390159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138238.390259:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333203072 00000100:00100000:2.0:1783138238.390267:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333203072 00000100:00100000:2.0:1783138238.390294:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333203200 00000100:00100000:2.0:1783138238.390309:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333203200 00000100:00100000:2.0:1783138238.390325:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138238.390331:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1869755333203072:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783138238.390359:0:24279:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:2.0:1783138238.390388:0:24279:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6bc248e9a4e97d8b 00002000:00100000:2.0:1783138238.390402:0:24279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff955782701000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:0.0:1783138238.390405:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333203328 00002000:00080000:2.0:1783138238.390406:0:24279:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1783138238.390408:0:24279:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1783138238.390409:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333203328 00000100:00100000:0.0:1783138238.390440:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333202816 00000100:00100000:0.0:1783138238.390443:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333202816 00000100:00100000:0.0:1783138238.390453:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333203584 00000100:00100000:0.0:1783138238.390455:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333203584 00000100:00100000:0.0:1783138238.390476:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783138238.390482:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869755333203328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138238.390529:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869755333203328:12345-0@lo:400:kworker.0 Request processed in 47us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138238.390536:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783138238.390552:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783138238.390557:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333202816:12345-0@lo:400:kworker.0 00002000:00080000:2.0:1783138238.390575:0:24279:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:0.0:1783138238.390584:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333202816:12345-0@lo:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138238.390590:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1783138238.390597:0:24279:0:(import.c:65:import_set_state_nolock()) ffff955782706000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138238.390599:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783138238.390612:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869755333203584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138238.390650:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1869755333203072:12345-0@lo:8:kworker.0 Request processed in 318us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138238.390655:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869755333203584:12345-0@lo:400:kworker.0 Request processed in 44us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138238.390657:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138238.390660:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783138238.390671:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138238.390675:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1869755333203200:12345-0@lo:8:kworker.0 00000100:00080000:0.0:1783138238.390678:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:2.0:1783138238.390686:0:24279:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1783138238.390702:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557838fed80 x1869755333203328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138238.390714:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869755333203328:0@lo:400:kworker.0 00000100:00100000:3.0:1783138238.396896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138238.397223:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333202944 00000100:00100000:0.0:1783138238.397233:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333202944 00000100:00100000:0.0:1783138238.397285:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783138238.397305:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333202944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138238.397376:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333202944:12345-0@lo:400:kworker.0 Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138238.397384:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783138238.397401:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333202560 00000100:00100000:3.0:1783138238.397406:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333202560 00000100:00100000:3.0:1783138238.397442:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783138238.397450:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3648:x1869755333202560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138238.397493:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3648:x1869755333202560:12345-0@lo:400:kworker.0 Request processed in 44us (7563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138238.397499:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783138238.397578:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333202560:0@lo:400:kworker.0 00000100:00100000:3.0:1783138238.397614:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333202944:0@lo:400:kworker.0 00000100:00100000:1.0:1783138238.397746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138238.397819:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333203456:0@lo:400:kworker.0 00000100:00100000:1.0:1783138238.397866:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138238.397919:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333203456 00000100:00100000:1.0:1783138238.397923:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333203456 00000100:00100000:1.0:1783138238.397969:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783138238.397975:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333203456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138238.398009:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333203456:12345-0@lo:400:kworker.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138238.398016:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1783138238.398035:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783138238.398067:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557838ff800 x1869755333203456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138238.398078:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333203456:0@lo:400:kworker.0 00000100:00100000:0.0:1783138238.403289:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333202688 00000100:00100000:0.0:1783138238.403315:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333202688 00000100:00100000:0.0:1783138238.403372:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783138238.403383:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333202688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138238.403480:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333202688:12345-0@lo:400:kworker.0 Request processed in 98us (5733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138238.403488:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1783138238.403852:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557838fdf80 x1869755333202816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138238.403869:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333202816:0@lo:400:kworker.0 00010000:00080000:0.0:1783138238.403900:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557838ff480 x1869755333203584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138238.403909:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869755333203584:0@lo:400:kworker.0 00010000:00080000:0.0:1783138238.403951:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557838fdc00 x1869755333203072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138238.403973:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783138238.403981:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783138238.403991:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783138238.403996:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783138238.404000:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783138238.404013:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783138238.404020:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333203072:0@lo:8:kworker.0 00000004:00080000:1.0:1783138238.404606:0:23514:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783138238.404725:0:23514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 707376094703ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783138238.404732:0:23514:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783138238.404861:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333202688:0@lo:400:kworker.0 00000004:00080000:3.0:1783138238.408857:0:23515:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783138238.408893:0:23515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1869755333203840:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1783138238.408972:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138238.409016:0:23515:0:(client.c:2701:ptlrpc_set_wait()) set ffff955888ba7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138238.409043:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783138238.409057:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333203712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138238.409064:0:24280:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783138238.409072:0:24280:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783138238.409084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138238.409271:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333203712 00000100:00100000:1.0:1783138238.409280:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333203712 00000100:00100000:1.0:1783138238.409386:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783138238.409396:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869755333203712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783138238.409427:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783138238.409478:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869755333203712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138238.409485:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783138238.409525:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558ace48380 x1869755333203712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138238.409559:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333203712:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783138238.419167:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138238.419247:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333203840 00000100:00100000:0.0:1783138238.419256:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333203840 00000100:00100000:3.0:1783138238.419716:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783138238.419727:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23515:x1869755333203840:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1783138238.426568:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1869755333203200:12345-0@lo:8:kworker.0 Request processed in 35882us (36435us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783138238.426583:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783138238.426667:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138238.426673:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783138238.426677:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333203200:0@lo:8:kworker.0 00000004:00080000:1.0:1783138238.428907:0:23505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1783138238.434324:0:24753:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1783138238.434333:0:24753:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1783138238.434444:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23515:x1869755333203840:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14714us (25467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138238.434456:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783138238.434581:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558ace4a300 x1869755333203840/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783138254 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138238.434598:0:23515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1869755333203840:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1783138238.434611:0:23515:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1783138238.434816:0:23515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1869755333203968:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1783138238.434854:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138238.434888:0:23515:0:(client.c:2701:ptlrpc_set_wait()) set ffff955888ba7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138238.434943:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333203968 00000100:00100000:2.0:1783138238.434950:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333203968 00000100:00100000:2.0:1783138238.434998:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138238.435007:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1869755333203968:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783138238.435034:0:24280:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1783138238.435064:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1869755333203968:12345-0@lo:5:osp-pre-0-1.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138238.435088:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783138238.435407:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558ace4a300 x1869755333203968/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783138254 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138238.435418:0:23515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1869755333203968:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1783138238.435428:0:23515:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1783138238.435457:0:23515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1869755333204096:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1783138238.435483:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138238.435498:0:23515:0:(client.c:2701:ptlrpc_set_wait()) set ffff955888ba7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138238.435511:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333204096 00000100:00100000:3.0:1783138238.435514:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333204096 00000100:00100000:3.0:1783138238.435537:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783138238.435543:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23515:x1869755333204096:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1783138238.435571:0:24279:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1783138238.456751:0:24274:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1783138238.457662:0:24274:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1783138238.459750:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23515:x1869755333204096:12345-0@lo:5:osp-pre-0-1.0 Request processed in 24197us (24256us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1783138238.459767:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1783138238.459907:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1783138238.460263:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558ace4a300 x1869755333204096/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783138254 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138238.460277:0:23515:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1783138238.460283:0:23515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1869755333204096:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783138238.460313:0:23515:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1783138238.460390:0:23515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23515:1869755333204224:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1783138238.460446:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138238.460485:0:23515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1f62180 going to sleep for 11 seconds 00000100:00100000:3.0:1783138238.460793:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333204224 00000100:00100000:3.0:1783138238.460802:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333204224 00000100:00100000:3.0:1783138238.460850:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138238.460859:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1869755333204224:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1783138238.460927:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1869755333204224:12345-0@lo:900:osp-pre-0-1.0 Request processed in 68us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138238.460935:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783138238.460966:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558b17c6300 x1869755333204224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783138254 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138238.460977:0:23515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23515:1869755333204224:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1783138239.480171:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138239.608122:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333204352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783138239.608208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138239.608301:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333204352 00000100:00100000:3.0:1783138239.608310:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333204352 00000100:00100000:3.0:1783138239.608365:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783138239.608375:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333204352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783138239.608417:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783138239.608469:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333204352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138239.608477:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783138239.608526:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333204352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783138239.609029:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783138239.609041:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333204480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783138239.609079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138239.609110:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333204480 00000100:00100000:3.0:1783138239.609115:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333204480 00000100:00100000:3.0:1783138239.609144:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783138239.609152:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333204480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783138239.609180:0:23513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783138239.609219:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333204480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138239.609226:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783138239.609260:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333204480:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783138240.529467:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138241.592716:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783138241.909451:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783138242.614068:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138243.640246:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783138243.700920:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138243.700927:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138243.700930:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138243.700934:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138243.700984:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138243.700988:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783138243.700993:0:8:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138243.701002:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 707 00000100:00080000:3.0:1783138243.701008:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783138243.701016:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9558c1ec2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138243.701039:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558ace4a300 x1869755333205248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138243.701098:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333204736:0@lo:400:kworker.0 00000100:00100000:3.0:1783138243.701169:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138243.701230:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333205376:0@lo:400:kworker.0 00000100:00100000:3.0:1783138243.701256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138243.701279:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783138243.701285:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333204864:0@lo:400:kworker.0 00000100:00100000:3.0:1783138243.701309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138243.701328:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333205504:0@lo:400:kworker.0 00000100:00100000:3.0:1783138243.701346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138243.701377:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333205248:0@lo:8:kworker.0 00000100:00100000:3.0:1783138243.701400:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138243.701435:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333204736 00000100:00100000:3.0:1783138243.701442:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333204736 00000100:00100000:3.0:1783138243.701485:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783138243.701494:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333204736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138243.701546:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333204736:12345-0@lo:400:kworker.0 Request processed in 53us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138243.701563:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783138243.701585:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333205376 00000100:00100000:3.0:1783138243.701589:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333205376 00000100:00100000:3.0:1783138243.701611:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333204864 00000100:00100000:3.0:1783138243.701613:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333204864 00000100:00100000:3.0:1783138243.701623:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333205504 00000100:00100000:3.0:1783138243.701625:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333205504 00000100:00100000:0.0:1783138243.701842:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3646:1869755333204608:0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.701875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138243.701902:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333205120:0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.701925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138243.702015:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783138243.702025:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333204992:0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.702050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138243.702067:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869755333205632:0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.702087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138243.702110:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333205632 00000100:00100000:0.0:1783138243.702113:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333205632 00000100:00100000:3.0:1783138243.702143:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783138243.702152:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333205376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138243.702187:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333205376:12345-0@lo:400:kworker.0 Request processed in 36us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138243.709562:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783138243.709586:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333204864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.709710:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333204864:12345-0@lo:400:kworker.0 Request processed in 135us (8397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138243.709720:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783138243.709741:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783138243.709748:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333205504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.709779:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333205504:12345-0@lo:400:kworker.0 Request processed in 32us (8431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138243.709785:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783138243.709797:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783138243.709803:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869755333205632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.709839:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869755333205632:12345-0@lo:400:kworker.0 Request processed in 36us (7750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138243.709845:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1783138243.709870:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783138243.709875:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138243.709888:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333204608 00000100:00100000:0.0:1783138243.709897:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333204608 00000100:00100000:0.0:1783138243.709934:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783138243.709956:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3646:x1869755333204608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.710002:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3646:x1869755333204608:12345-0@lo:400:kworker.0 Request processed in 48us (8126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138243.710008:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783138243.710044:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333205248 00000100:00100000:0.0:1783138243.710048:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333205248 00000100:00100000:0.0:1783138243.710073:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333205120 00000100:00100000:0.0:1783138243.710077:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333205120 00000100:00100000:0.0:1783138243.710108:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138243.710114:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333205120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.710145:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333205120:12345-0@lo:400:kworker.0 Request processed in 31us (8219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138243.710150:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138243.710160:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138243.710164:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1869755333205248:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783138243.710184:0:24278:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783138243.710226:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1869755333205248:12345-0@lo:8:kworker.0 Request processed in 60us (8824us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783138243.710232:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138243.710248:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333204992 00000100:00100000:0.0:1783138243.710251:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333204992 00000100:00100000:0.0:1783138243.710272:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783138243.710278:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333204992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.710308:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333204992:12345-0@lo:400:kworker.0 Request processed in 31us (8258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138243.710314:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1783138243.710342:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783138243.710376:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138243.710383:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783138243.710387:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333205248:0@lo:8:kworker.0 00000100:00100000:0.0:1783138243.710441:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333204992:0@lo:400:kworker.0 00010000:00080000:0.0:1783138243.710456:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d5180 x1869755333205632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138243.710466:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869755333205632:0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.710476:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3646:1869755333204608:0@lo:400:kworker.0 00010000:00080000:0.0:1783138243.710485:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558ace48000 x1869755333205120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783138259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138243.710493:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333205120:0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.710609:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138243.710621:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333205760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138243.710679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138243.710715:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333205760 00000100:00100000:0.0:1783138243.710719:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333205760 00000100:00100000:0.0:1783138243.710744:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783138243.710750:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333205760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138243.710770:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138243.710803:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333205760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138243.710809:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783138243.710832:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff955784069180 x1869755333205760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138243.710852:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333205760:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1783138243.710882:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558ace4aa00 x1869755333204864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138243.710892:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333204864:0@lo:400:kworker.0 00010000:00080000:0.0:1783138243.710907:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d7800 x1869755333205504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138243.710915:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333205504:0@lo:400:kworker.0 00000100:00100000:0.0:1783138243.710928:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333204736:0@lo:400:kworker.0 00010000:00080000:0.0:1783138243.710940:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d4380 x1869755333205376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138243.710947:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333205376:0@lo:400:kworker.0 00000100:00100000:3.0:1783138243.712852:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1783138244.668506:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138244.727000:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333205888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138244.727078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138244.727137:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333205888 00000100:00100000:2.0:1783138244.727145:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333205888 00000100:00100000:2.0:1783138244.727200:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138244.727224:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333205888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783138244.727270:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783138244.727319:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333205888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138244.727326:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138244.727381:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333205888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783138244.731010:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138224/real 1783138224] req@ffff955784069500 x1869755333196288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138244.731045:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff955784069500 x1869755333196288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138244.731100:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138224/real 1783138224] req@ffff955784068e00 x1869755333196416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138244.731112:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff955784068e00 x1869755333196416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783138244.731134:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578266b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138244.731144:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783138244.731149:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333196288:0@lo:8:kworker.0 00000100:00080000:3.0:1783138244.731154:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138244.731172:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783138244.731176:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333196416:0@lo:8:kworker.0 00000100:00080000:3.0:1783138244.732870:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138244.732877:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783138244.732880:0:8:0:(import.c:65:import_set_state_nolock()) ffff95578266b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138244.732887:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:3.0:1783138244.732893:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783138244.732900:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95578266b800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138244.732921:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9557842d6300 x1869755333206272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138244.732936:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138244.732940:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783138244.732942:0:8:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138244.732945:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:3.0:1783138244.732948:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783138244.732951:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9558b1ced800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138244.732963:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9557842d7100 x1869755333206400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138244.732984:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138244.732987:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783138244.732989:0:8:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138244.732992:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 712 00000100:00080000:3.0:1783138244.732994:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783138244.732997:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9558c1ec2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138244.733016:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9557842d5f80 x1869755333206784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138244.733063:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333206144:0@lo:400:kworker.0 00000100:00100000:3.0:1783138244.733134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138244.733169:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333207040:0@lo:400:kworker.0 00000100:00100000:3.0:1783138244.733205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138244.733230:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783138244.733236:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869755333206528:0@lo:400:kworker.0 00000100:00100000:3.0:1783138244.733259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138244.733276:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869755333207168:0@lo:400:kworker.0 00000100:00100000:3.0:1783138244.733302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138244.733333:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333206144 00000100:00100000:3.0:1783138244.733340:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333206144 00000100:00100000:3.0:1783138244.733382:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783138244.733392:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333206144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.733968:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333206016:0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.734003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138244.734032:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869755333206912:0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.734050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138244.734067:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783138244.734072:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333206656:0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.734089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138244.734112:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333206016 00000100:00100000:2.0:1783138244.734116:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333206016 00000100:00100000:2.0:1783138244.734143:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783138244.734148:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3648:x1869755333206016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.734182:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:3648:x1869755333206016:12345-0@lo:400:kworker.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138244.734201:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783138244.734232:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333206656 00000100:00100000:2.0:1783138244.734235:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333206656 00000100:00100000:2.0:1783138244.734257:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138244.734262:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333206656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.734287:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333206656:12345-0@lo:400:kworker.0 Request processed in 25us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138244.734301:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783138244.734337:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d5500 x1869755333206656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783138260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138244.734350:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333206656:0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.734358:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333206016:0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.734514:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333207296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138244.734667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138244.734863:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333206144:12345-0@lo:400:kworker.0 Request processed in 1472us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138244.734870:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783138244.734884:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333207296 00000100:00100000:3.0:1783138244.734887:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333207296 00000100:00100000:2.0:1783138244.735704:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333207040 00000100:00100000:2.0:1783138244.735710:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333207040 00000100:00100000:2.0:1783138244.735734:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333206528 00000100:00100000:2.0:1783138244.735737:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333206528 00000100:00100000:2.0:1783138244.735745:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333207168 00000100:00100000:2.0:1783138244.735747:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333207168 00000100:00100000:2.0:1783138244.735756:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333206912 00000100:00100000:2.0:1783138244.735758:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333206912 00000100:00100000:2.0:1783138244.735769:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783138244.735776:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333207040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.735825:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333207040:12345-0@lo:400:kworker.0 Request processed in 49us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138244.735831:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783138244.735842:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138244.735846:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869755333206528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.735867:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869755333206528:12345-0@lo:400:kworker.0 Request processed in 20us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138244.735872:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138244.735888:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783138244.735893:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869755333207168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.735916:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869755333207168:12345-0@lo:400:kworker.0 Request processed in 23us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138244.735921:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783138244.735929:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783138244.735934:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869755333206912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.735959:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869755333206912:12345-0@lo:400:kworker.0 Request processed in 25us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138244.735965:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1783138244.735999:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d6680 x1869755333206912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138244.736013:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869755333206912:0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.736036:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333206272:0@lo:8:kworker.0 00000100:00100000:2.0:1783138244.736064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138244.736091:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333206400:0@lo:8:kworker.0 00000100:00100000:2.0:1783138244.736108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138244.736121:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333206784:0@lo:8:kworker.0 00000100:00100000:2.0:1783138244.736137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138244.736160:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333206272 00000100:00100000:2.0:1783138244.736163:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333206272 00000100:00100000:2.0:1783138244.736177:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333206400 00000100:00100000:2.0:1783138244.736179:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333206400 00000100:00100000:2.0:1783138244.736185:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333206784 00000100:00100000:2.0:1783138244.736196:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333206784 00000100:00100000:2.0:1783138244.736206:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138244.736216:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869755333206272:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783138244.736238:0:24280:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:2.0:1783138244.736262:0:24280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6bc248e9a4e97d92 00002000:00100000:2.0:1783138244.736274:0:24280:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff955782702000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783138244.736279:0:24280:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783138244.736281:0:24280:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783138244.736345:0:24280:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783138244.736364:0:24280:0:(import.c:65:import_set_state_nolock()) ffff955782706800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138244.736396:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1869755333206272:12345-0@lo:8:kworker.0 Request processed in 179us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138244.736402:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138244.736413:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138244.736417:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869755333206400:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783138244.736427:0:24280:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783138244.736447:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869755333206400:12345-0@lo:8:kworker.0 Request processed in 29us (338us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138244.736452:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138244.736460:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138244.736464:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869755333206784:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783138244.736471:0:24280:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783138244.736487:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869755333206784:12345-0@lo:8:kworker.0 Request processed in 22us (350us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138244.736492:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1783138244.736525:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d6300 x1869755333206272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138244.736545:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783138244.736551:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783138244.736559:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783138244.736565:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783138244.736568:0:3644:0:(import.c:65:import_set_state_nolock()) ffff95578266b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783138244.736582:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783138244.736587:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333206272:0@lo:8:kworker.0 00000100:00080000:2.0:1783138244.736597:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138244.736601:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138244.736604:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333206400:0@lo:8:kworker.0 00000100:00080000:2.0:1783138244.736610:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138244.736612:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138244.736615:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333206784:0@lo:8:kworker.0 00000100:00100000:1.0:1783138244.738269:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783138244.738285:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333207296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783138244.738322:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138244.738407:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333207296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (3738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138244.738415:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1783138244.738478:0:22796:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1783138244.738512:0:22796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22796:1869755333207552:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783138244.738557:0:22796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138244.738586:0:22796:0:(client.c:2701:ptlrpc_set_wait()) set ffff955784d4e0c0 going to sleep for 11 seconds 00000004:00080000:1.0:1783138244.738603:0:22795:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783138244.740818:0:22795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 713712185160ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783138244.740830:0:22795:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783138244.740880:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333207424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138244.740944:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138244.741001:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333207424 00000100:00100000:1.0:1783138244.741008:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333207424 00000100:00100000:1.0:1783138244.741061:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138244.741071:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869755333207424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783138244.741095:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783138244.741142:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869755333207424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138244.741150:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1783138244.741169:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783138244.741210:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558b17c5180 x1869755333207424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138244.741228:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333207424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138244.741267:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333207296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138244.741291:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333207552 00000100:00100000:1.0:1783138244.741295:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333207552 00000100:00100000:1.0:1783138244.741320:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783138244.741326:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22796:x1869755333207552:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:2.0:1783138244.748012:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d4000 x1869755333206528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138244.748033:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869755333206528:0@lo:400:kworker.0 00010000:00080000:2.0:1783138244.748048:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d4e00 x1869755333207168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138244.748056:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869755333207168:0@lo:400:kworker.0 00000100:00100000:2.0:1783138244.748069:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333206144:0@lo:400:kworker.0 00010000:00080000:2.0:1783138244.748080:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9557842d5c00 x1869755333207040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138244.748110:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333207040:0@lo:400:kworker.0 00002000:00080000:1.0:1783138244.758698:0:24280:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1783138244.758712:0:24280:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1783138244.758719:0:24280:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000004:00080000:2.0:1783138244.769760:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1783138244.777967:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.777980:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.777997:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.778001:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.778008:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.778025:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.778050:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.778058:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.778087:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138244.778922:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.778938:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.778949:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834dee00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.778953:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.778962:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.778981:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.778989:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97d99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.779009:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.779011:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.779013:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783138244.781430:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.781448:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.781467:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.781472:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.781478:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.781493:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.781505:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.781514:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.781556:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138244.782755:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.782765:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.782777:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.782782:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.782798:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.782820:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.782829:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97da0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.782849:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.782850:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.782852:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138244.785652:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138244.785667:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.785695:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1783138244.785699:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138244.785706:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.785739:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.785751:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.785759:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.785785:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138244.786232:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138244.786240:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138244.786292:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302ac00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138244.786297:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138244.786306:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138244.786326:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138244.786333:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008013ba9e/0x6bc248e9a4e97da7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138244.786354:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138244.786356:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138244.786358:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138244.788800:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138244.788816:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.788834:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1783138244.788838:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138244.788846:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.788859:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.788869:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.788895:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.788920:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138244.789492:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.789500:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.789510:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302b200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.789515:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.789525:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.789546:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.789567:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb68fbe4/0x6bc248e9a4e97dae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.789586:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.789589:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.789591:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.790551:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.790562:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.790574:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.790578:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.790582:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.790596:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.790604:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.790612:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.790670:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783138244.791206:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.791219:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791229:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.791242:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.791254:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791265:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791274:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791281:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791298:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783138244.791309:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138244.791315:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791322:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7024a00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.791327:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791336:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791364:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791372:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e89bb99c/0x6bc248e9a4e97db5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791390:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.791394:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791401:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7025800 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.791404:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791412:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791421:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791427:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5786dc0/0x6bc248e9a4e97dbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.791436:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.791438:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.791445:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.792150:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.792161:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792170:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.792173:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.792178:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792200:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792208:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792215:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792284:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138244.792295:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.792299:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792305:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7024c00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.792308:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792328:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792340:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792347:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000065e9167/0x6bc248e9a4e97dc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.792362:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.792364:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.792365:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.793758:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.793772:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.793785:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.793788:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.793794:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.793806:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.793815:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.793833:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.793855:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138244.794152:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.794159:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.794168:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7024000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.794172:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.794195:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.794213:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.794220:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001323ac1/0x6bc248e9a4e97dca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.794247:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.794249:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.794250:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.795118:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.795279:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.795288:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.795300:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.795304:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.795310:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.795321:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.795330:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.795338:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.795362:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138244.795799:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.795812:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.795820:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7025a00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.795824:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.795833:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.795848:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.795856:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fe505cd/0x6bc248e9a4e97dd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.795874:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.795876:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.795878:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.796156:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.796162:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.796176:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.796180:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.796193:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.796205:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.796213:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.796220:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.796248:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138244.796447:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138244.796453:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.796461:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7025200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138244.796464:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.796471:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.796482:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.796489:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbdb2fa7/0x6bc248e9a4e97dd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.796504:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.796505:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.796507:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.797039:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.797046:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797055:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.797058:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.797062:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797072:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797093:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797100:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797120:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138244.797283:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.797289:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.797297:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa2000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.797300:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.797320:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.797333:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.797340:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b87f25/0x6bc248e9a4e97ddf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.797356:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.797358:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.797359:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.797608:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.797614:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797622:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.797625:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.797663:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797672:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797680:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797688:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.797712:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138244.798019:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138244.798025:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.798043:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2042400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138244.798047:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.798054:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.798065:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.798073:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048ff9c7b/0x6bc248e9a4e97de6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.798088:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.798089:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.798091:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.798216:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.798221:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798229:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.798242:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.798246:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798256:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798263:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798270:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798286:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138244.798431:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.798436:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.798444:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2043e00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.798447:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.798455:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.798466:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.798484:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb2bf46/0x6bc248e9a4e97ded lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.798499:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.798501:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.798503:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.798823:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.798829:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798837:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.798860:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.798864:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798874:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798881:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798888:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.798909:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138244.799119:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138244.799125:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.799133:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2042e00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138244.799136:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.799144:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.799164:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.799171:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac277700/0x6bc248e9a4e97df4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.799195:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.799197:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.799198:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138244.799318:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138244.799324:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.799332:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1783138244.799335:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138244.799339:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.799348:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.799356:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.799368:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.799420:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783138244.803137:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.803151:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.803167:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.803171:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.803177:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.803201:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.803211:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.803219:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803483:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138244.803491:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803499:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2043000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.803504:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803514:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803531:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803538:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014b133a/0x6bc248e9a4e97dfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803559:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.803562:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803576:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df600 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.803579:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803587:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803598:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.803606:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.803607:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.803609:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.804080:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.804087:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf8d19c6/0x6bc248e9a4e97e02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.804594:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.804601:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.804610:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.804613:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.804618:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.804664:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.804674:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.804682:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.804763:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.804770:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.804777:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834dfc00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.804780:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.804789:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.804802:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.804810:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.804811:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.804813:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.804983:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.804988:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001294e6b6/0x6bc248e9a4e97e09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.805345:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.805354:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.805373:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.805379:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.805385:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.805392:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.805399:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.805406:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.805575:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.805580:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.805587:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834dfa00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.805590:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.805597:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.805608:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.805622:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.805624:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.805625:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.817348:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.817363:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000860f1908/0x6bc248e9a4e97e10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.817831:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783138244.817962:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.817971:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.817995:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.818000:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.818006:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.818020:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.818031:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.818038:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.818099:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783138244.818497:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.818503:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.818512:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.818515:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.818518:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.818528:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.818547:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.818552:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820465:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138244.820479:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820512:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834de800 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.820516:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820525:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820546:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820553:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d4ad7c5/0x6bc248e9a4e97e17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820579:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.820583:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820590:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.820593:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820601:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820617:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.820663:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.820666:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.820669:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.820831:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.820839:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adee60c6/0x6bc248e9a4e97e1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.821318:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.821326:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821338:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.821342:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.821348:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821359:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821368:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821388:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821413:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138244.821771:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.821777:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.821786:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834de400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.821789:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.821797:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.821809:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.821817:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c66588da/0x6bc248e9a4e97e25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.821834:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.821836:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.821837:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783138244.821938:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.821946:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821953:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.821956:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.821960:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821968:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821976:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.821983:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.822029:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783138244.822456:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.822462:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.822475:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.822478:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.822482:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.822491:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.822500:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.822507:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824579:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138244.824593:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824627:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834dea00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.824775:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824789:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824810:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824818:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8a4ce14/0x6bc248e9a4e97e2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824843:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.824846:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824853:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834dee00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.824856:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824863:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824873:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.824888:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.824890:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.824892:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.825030:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.825143:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.825151:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efec5e0d/0x6bc248e9a4e97e33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.825719:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.825726:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.825736:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.825741:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.825747:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.825769:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.825779:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.825786:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.826009:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.826014:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.826022:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.826026:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.826034:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.826047:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.826055:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.826057:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.826058:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.826118:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.826123:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514827e6/0x6bc248e9a4e97e3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.826485:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.826492:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.826500:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.826503:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.826507:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.826516:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.826533:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.826540:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.826571:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.826576:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.826583:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df800 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.826586:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.826593:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.826603:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.826611:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.826612:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.826614:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.826857:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.826864:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000327fc23/0x6bc248e9a4e97e41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.827244:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.827250:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.827260:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.827263:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.827267:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.827276:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.827284:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.827301:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.827420:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.827426:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.827433:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834df000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.827436:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.827451:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.827463:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.827473:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.827475:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.827477:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.827547:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.827553:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf4fcc31/0x6bc248e9a4e97e48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.828003:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.828011:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.828020:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.828023:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.828027:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.828037:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.828044:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.828051:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.828139:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.828146:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.828153:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834de200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.828162:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.828170:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.828181:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.828200:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.828202:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.828203:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.828343:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.828349:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfb304f2/0x6bc248e9a4e97e4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.828759:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.828766:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.828774:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.828777:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.828780:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.828790:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.828798:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.828806:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.829012:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138244.829302:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1783138244.829387:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.829394:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.829408:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.829411:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.829415:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.829425:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.829433:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.829441:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.829465:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.829471:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.829479:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a5597200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.829483:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.829492:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.829505:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.829512:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.829519:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.829522:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.829545:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.829553:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9557834de000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.829557:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.829564:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.829575:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.829583:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3c4204/0x6bc248e9a4e97e56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.829608:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.829609:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.829611:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.829849:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.829855:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c098767/0x6bc248e9a4e97e5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.829976:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783138244.830355:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.830361:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830369:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.830373:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.830377:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830399:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830408:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830415:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830475:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783138244.830827:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.830833:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830842:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.830845:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.830848:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830857:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830864:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.830882:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831015:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138244.831022:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831030:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a5596a00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.831033:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831042:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831057:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831062:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c73e5fa/0x6bc248e9a4e97e64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831079:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138244.831083:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831088:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a5596e00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138244.831099:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831106:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831116:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.831124:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.831126:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138244.831128:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.831243:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.831248:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001feada55/0x6bc248e9a4e97e6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138244.831621:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138244.831661:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.831670:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1783138244.831674:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138244.831678:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.831688:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.831696:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138244.831704:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.831848:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138244.831855:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.831862:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a5597e00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138244.831865:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.831874:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.831887:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138244.832020:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.832022:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138244.832024:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138244.832088:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783138244.832093:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006848ada6/0x6bc248e9a4e97e72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138244.832146:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783138244.832490:0:24280:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1783138244.832625:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22796:x1869755333207552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 91295us (94064us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138244.832718:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783138244.832830:0:22796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22796:1869755333207552:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783138244.832844:0:22796:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1783138244.832883:0:22796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22796:1869755333207680:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783138244.832998:0:22796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138244.833059:0:22796:0:(client.c:2701:ptlrpc_set_wait()) set ffff955888ba7780 going to sleep for 11 seconds 00000100:00100000:0.0:1783138244.833108:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333207680 00000100:00100000:0.0:1783138244.833115:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333207680 00000100:00100000:0.0:1783138244.833202:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783138244.833211:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22796:x1869755333207680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783138244.833307:0:24279:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1783138244.842142:0:24274:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1783138244.842308:0:24274:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783138244.842594:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22796:x1869755333207680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9381us (9592us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783138244.842605:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138244.842784:0:22796:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1783138244.842794:0:22796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22796:1869755333207680:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783138244.842817:0:22796:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:01000004:1.0:1783138245.277686:0:25095:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783138245.277690:0:25095:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783138245.277691:0:25095:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783138245.277805:0:25095:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff955782aed800 00000020:01000004:1.0:1783138245.277821:0:25095:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783138245.277836:0:25095:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783138245.277850:0:25095:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff955781f43380) 00000020:00000080:1.0:1783138245.277876:0:25095:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783138245.353169:0:25095:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783138245.356198:0:25095:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783138245.356777:0:25095:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783138245.357087:0:25095:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783138245.357720:0:25095:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783138245.358568:0:25095:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783138245.359055:0:25095:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1783138245.365982:0:25095:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783138245.366218:0:25095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783138245.366233:0:25095:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783138245.366244:0:25095:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6bc248e9a4e97e80 00000020:01000004:3.0:1783138245.366251:0:25095:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783138245.366272:0:25095:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783138245.366277:0:25095:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783138245.366283:0:25095:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783138245.366330:0:25095:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1783138245.366335:0:25095:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783138245.390972:0:25095:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783138245.391015:0:25095:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1783138245.391020:0:25095:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783138245.391027:0:25095:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138245.391028:0:25095:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138245.391030:0:25095:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138245.391031:0:25095:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138245.391032:0:25095:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138245.391033:0:25095:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138245.391035:0:25095:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138245.391036:0:25095:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783138245.391039:0:25095:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1783138245.391042:0:25095:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783138245.391043:0:25095:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138245.391044:0:25095:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138245.391045:0:25095:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138245.391045:0:25095:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138245.391046:0:25095:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138245.391047:0:25095:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138245.391048:0:25095:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138245.391049:0:25095:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783138245.391077:0:25095:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783138245.391100:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333207808:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783138245.391182:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.391226:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981840 going to sleep for 11 seconds 00000100:00100000:0.0:1783138245.391278:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333207808 00000100:00100000:0.0:1783138245.391287:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333207808 00000100:00100000:0.0:1783138245.391347:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783138245.391357:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:25095:x1869755333207808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783138245.391392:0:22764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783138245.391396:0:22764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1783138245.391400:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783138245.392689:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:25095:x1869755333207808:12345-0@lo:253:mount.lustre.0 Request processed in 1328us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.392703:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783138245.392927:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333207808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783138245.392941:0:25095:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783138245.392944:0:25095:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783138245.392946:0:25095:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138245.392947:0:25095:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138245.392948:0:25095:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138245.392949:0:25095:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138245.392950:0:25095:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138245.392952:0:25095:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138245.392953:0:25095:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138245.392954:0:25095:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783138245.392976:0:25095:0:(tgt_mount.c:101:server_register_mount()) register mount ffff955782aed800 from lustre-OST0001 10000000:01000000:1.0:1783138245.393009:0:25095:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783138245.393011:0:25095:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783138245.393020:0:25095:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9558a6133380 local copy 00010000:00010000:1.0:1783138245.393045:0:25095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138245.393148:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333207936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138245.393194:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.393276:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138245.397818:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333207936 00000100:00100000:2.0:1783138245.397833:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333207936 00000100:00100000:2.0:1783138245.397903:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783138245.397915:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:25095:x1869755333207936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138245.398497:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:25095:x1869755333207936:12345-0@lo:501:mount.lustre.0 Request processed in 583us (5300us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783138245.398506:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783138245.399821:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333207936:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783138245.399854:0:25095:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783138245.399895:0:25095:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783138245.399904:0:25095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.399915:0:25095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b7024400/0x6bc248e9a4e97ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97aba expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138245.399948:0:25095:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff955782aed800 10000000:01000000:1.0:1783138245.399953:0:25095:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783138245.399958:0:25095:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783138245.399961:0:25095:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138245.399966:0:25095:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783138245.399968:0:25095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783138245.399999:0:25095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302aa00/0x6bc248e9a4e97e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.400006:0:25095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302aa00/0x6bc248e9a4e97e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.400016:0:25095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302aa00/0x6bc248e9a4e97e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138245.400052:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138245.400099:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.400190:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138245.404785:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333208064 00000100:00100000:0.0:1783138245.404803:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333208064 00000100:00100000:0.0:1783138245.404866:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783138245.404878:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:25095:x1869755333208064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138245.404908:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138245.404926:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558a5596200/0x6bc248e9a4e97e8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97e87 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.404956:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558a5596200/0x6bc248e9a4e97e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97e87 expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.404968:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558a5596200/0x6bc248e9a4e97e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97e87 expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.404977:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558a5596200, rc 0) 00000100:00100000:0.0:1783138245.405261:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208064:12345-0@lo:101:mount.lustre.0 Request processed in 385us (5161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.405268:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783138245.411058:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138245.411093:0:25095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302aa00/0x6bc248e9a4e97e87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97e8e expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138245.411106:0:25095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302aa00/0x6bc248e9a4e97e87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97e8e expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138245.412391:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1783138245.414979:0:25095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138245.418455:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783138245.422604:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783138245.422935:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783138245.422960:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783138245.422974:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783138245.422987:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783138245.423001:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783138245.423039:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783138245.423053:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1783138245.423077:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1783138245.423083:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1783138245.423212:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138245.423288:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138245.423368:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a5d976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138245.427653:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333208192 00000100:00100000:0.0:1783138245.427672:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333208192 00000100:00100000:0.0:1783138245.427746:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783138245.427758:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138245.427966:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208192:12345-0@lo:501:mount.lustre.0 Request processed in 210us (4678us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.427974:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783138245.428236:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138245.428291:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138245.428347:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.428385:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783138245.429006:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333208320 00000100:00100000:0.0:1783138245.429012:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333208320 00000100:00100000:0.0:1783138245.429057:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783138245.429065:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138245.432753:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208320:12345-0@lo:503:mount.lustre.0 Request processed in 3679us (4396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138245.432771:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783138245.432932:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208320:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783138245.433413:0:25095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783138245.434151:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138245.434238:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.434279:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783138245.434419:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333208448 00000100:00100000:2.0:1783138245.434426:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333208448 00000100:00100000:2.0:1783138245.434516:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783138245.434526:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138245.437437:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208448:12345-0@lo:502:mount.lustre.0 Request processed in 2901us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138245.437451:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783138245.439741:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138245.440062:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1783138245.440096:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1783138245.440113:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1783138245.440128:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1783138245.440141:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1783138245.440155:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1783138245.440169:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1783138245.440197:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1783138245.440213:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1783138245.440253:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138245.440326:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.446908:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782981c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138245.448357:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333208576 00000100:00100000:3.0:1783138245.448372:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333208576 00000100:00100000:3.0:1783138245.448441:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783138245.448453:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138245.448955:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208576:12345-0@lo:502:mount.lustre.0 Request processed in 502us (8627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.448964:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783138245.449061:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138245.449145:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1783138245.449158:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1783138245.452159:0:25099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783138245.452172:0:25099:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783138245.452189:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138245.452192:0:25099:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783138245.452201:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783138245.452217:0:25099:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff955781f40000) 00000020:00000080:1.0:1783138245.452243:0:25099:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783138245.452249:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783138245.452347:0:25099:0:(tgt_mount.c:153:server_get_mount()) get mount ffff955782aed800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783138245.452355:0:25099:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783138245.452362:0:25099:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6bc248e9a4e97e9c 00010000:00010000:1.0:1783138245.467297:0:25099:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1783138245.469358:0:25099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1783138245.476061:0:25099:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1783138245.478578:0:25099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783138245.478592:0:25099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138245.478605:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138245.478607:0:25099:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783138245.478610:0:25099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138245.478614:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138245.478615:0:25099:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783138245.478618:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783138245.478620:0:25099:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783138245.478622:0:25099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138245.478624:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138245.478625:0:25099:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783138245.478770:0:25099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138245.478775:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138245.478776:0:25099:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783138245.478780:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783138245.478810:0:25099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138245.478812:0:25099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138245.478813:0:25099:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783138245.478817:0:25099:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1783138245.488942:0:25095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1783138245.488986:0:25095:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783138245.489010:0:25095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302aa00/0x6bc248e9a4e97e87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97e8e expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.489033:0:25095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302aa00/0x6bc248e9a4e97e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97e8e expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138245.489042:0:25095:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff955782aed800 from 1 10000000:01000000:0.0:1783138245.489044:0:25095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783138245.489081:0:25095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.489088:0:25095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.489099:0:25095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.489123:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783138245.489194:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.489232:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b7091900 going to sleep for 11 seconds 00000100:00100000:1.0:1783138245.489283:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333208704 00000100:00100000:1.0:1783138245.489290:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333208704 00000100:00100000:1.0:1783138245.489346:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783138245.489354:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:25095:x1869755333208704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138245.489366:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138245.489377:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97ea3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.489398:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.489407:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.489421:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302a000, rc 0) 00000100:00100000:1.0:1783138245.489454:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333208704:12345-0@lo:101:mount.lustre.0 Request processed in 101us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138245.489471:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783138245.489838:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138245.489853:0:25095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.489861:0:25095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783138245.490741:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1783138245.491019:0:25095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138245.491242:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1783138245.491268:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1783138245.491292:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1783138245.491306:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1783138245.491319:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1783138245.491332:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1783138245.491346:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1783138245.491358:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1783138245.491369:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1783138245.491380:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1783138245.491389:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1783138245.491403:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1783138245.491407:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1783138245.491908:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138245.491969:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.492050:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b70910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138245.498326:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333208832 00000100:00100000:2.0:1783138245.498340:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333208832 00000100:00100000:2.0:1783138245.498404:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783138245.498414:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333208832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138245.498818:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333208832:12345-0@lo:501:mount.lustre.0 Request processed in 405us (6848us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138245.498827:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783138245.501019:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138245.501090:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138245.501163:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.501263:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b70910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138245.503916:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333208960 00000100:00100000:2.0:1783138245.503934:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333208960 00000100:00100000:2.0:1783138245.503988:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783138245.503997:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333208960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138245.506300:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333208960:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783138245.507045:0:25095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783138245.508001:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138245.508090:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138245.508223:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333208960:12345-0@lo:503:mount.lustre.0 Request processed in 4225us (7058us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138245.508244:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783138245.508296:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333209088 00000100:00100000:2.0:1783138245.508302:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333209088 00000100:00100000:2.0:1783138245.508332:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783138245.508339:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333209088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138245.508444:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333209088:12345-0@lo:502:mount.lustre.0 Request processed in 105us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138245.508450:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783138245.509020:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff955881254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138245.509044:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138245.509281:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1783138245.509312:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1783138245.509344:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1783138245.509359:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1783138245.509371:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1783138245.509383:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1783138245.509396:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1783138245.509409:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1783138245.509422:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1783138245.509435:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1783138245.509446:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1783138245.510117:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138245.510186:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.510247:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff955881254d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138245.514840:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333209216 00000100:00100000:2.0:1783138245.514857:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333209216 00000100:00100000:2.0:1783138245.515161:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783138245.515181:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333209216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138245.515369:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333209216:12345-0@lo:502:mount.lustre.0 Request processed in 199us (5194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138245.515378:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783138245.515509:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138245.515605:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1783138245.515620:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783138245.516894:0:25103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138245.516909:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138245.516912:0:25103:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783138245.516920:0:25103:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff955782aed800 00000020:00000080:3.0:1783138245.516923:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138245.516930:0:25103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138245.516933:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138245.516934:0:25103:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783138245.516936:0:25103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138245.516939:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138245.516940:0:25103:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783138245.516943:0:25103:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff955782aed800 00000020:00000080:3.0:1783138245.516945:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138245.517015:0:25103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138245.517019:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138245.517020:0:25103:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783138245.517023:0:25103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138245.517026:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138245.517027:0:25103:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138245.517031:0:25103:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff955782aed800 00000020:00000080:3.0:1783138245.517033:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138245.517051:0:25103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138245.517053:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138245.517054:0:25103:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138245.517057:0:25103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138245.517066:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138245.517067:0:25103:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783138245.517072:0:25103:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff955782aed800 00000020:00000080:3.0:1783138245.517074:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138245.517098:0:25103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138245.517101:0:25103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138245.517102:0:25103:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783138245.517105:0:25103:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1783138245.517301:0:25095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783138245.517329:0:25095:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783138245.517346:0:25095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.517357:0:25095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138245.517412:0:25095:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783138245.517415:0:25095:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff955782aed800 10000000:01000000:0.0:1783138245.517418:0:25095:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff955782aed800 10000000:01000000:0.0:1783138245.517427:0:25095:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783138245.517433:0:25095:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff955782aed800 from 1 10000000:01000000:0.0:1783138245.517436:0:25095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783138245.517488:0:25095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558a5596800/0x6bc248e9a4e97eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.517497:0:25095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558a5596800/0x6bc248e9a4e97eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.517509:0:25095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558a5596800/0x6bc248e9a4e97eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.517535:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783138245.517599:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.517677:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b7091900 going to sleep for 11 seconds 00000100:00100000:3.0:1783138245.517796:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333209344 00000100:00100000:3.0:1783138245.517803:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333209344 00000100:00100000:3.0:1783138245.517854:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783138245.517989:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:25095:x1869755333209344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138245.518004:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138245.518018:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558c2042200/0x6bc248e9a4e97eb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97eb1 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138245.518042:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558c2042200/0x6bc248e9a4e97eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97eb1 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138245.518051:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558c2042200/0x6bc248e9a4e97eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97eb1 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138245.518061:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558c2042200, rc 0) 00000100:00100000:3.0:1783138245.518099:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209344:12345-0@lo:101:mount.lustre.0 Request processed in 237us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.518107:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783138245.518773:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138245.518792:0:25095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558a5596800/0x6bc248e9a4e97eb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97eb8 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.518801:0:25095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558a5596800/0x6bc248e9a4e97eb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97eb8 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783138245.522249:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1783138245.525978:0:25095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138245.526260:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1783138245.526289:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1783138245.526304:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1783138245.526319:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1783138245.526333:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1783138245.526347:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1783138245.526374:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1783138245.526389:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1783138245.526403:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1783138245.526417:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1783138245.526431:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1783138245.526446:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1783138245.526461:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1783138245.526488:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1783138245.526501:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1783138245.526513:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1783138245.526526:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1783138245.526537:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1783138245.526548:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1783138245.526559:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1783138245.526570:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1783138245.526581:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1783138245.526593:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1783138245.526605:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1783138245.526617:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1783138245.526655:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1783138245.526671:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1783138245.526683:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1783138245.526695:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1783138245.526717:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1783138245.526731:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1783138245.526744:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1783138245.526757:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1783138245.526769:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1783138245.526780:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1783138245.526791:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1783138245.526805:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1783138245.526819:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1783138245.526832:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1783138245.526856:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1783138245.526870:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1783138245.526881:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1783138245.526895:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1783138245.526908:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1783138245.526921:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1783138245.526948:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1783138245.526966:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1783138245.526980:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1783138245.527088:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1783138245.527106:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1783138245.527120:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1783138245.527125:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1783138245.527238:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138245.527306:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.527349:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b70910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138245.533562:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333209472 00000100:00100000:3.0:1783138245.533581:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333209472 00000100:00100000:3.0:1783138245.533673:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783138245.533684:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138245.533907:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209472:12345-0@lo:501:mount.lustre.0 Request processed in 224us (6599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.533916:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783138245.533989:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138245.534043:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138245.534087:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138245.534116:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558945033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138245.534545:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333209600 00000100:00100000:0.0:1783138245.534551:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333209600 00000100:00100000:0.0:1783138245.534593:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783138245.534600:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138245.534717:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209600:12345-0@lo:503:mount.lustre.0 Request processed in 117us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.534723:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783138245.535147:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783138245.535674:0:25095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783138245.535768:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138245.535818:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138245.535851:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333209728 00000100:00100000:3.0:1783138245.535856:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333209728 00000100:00100000:3.0:1783138245.536074:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783138245.536082:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138245.536186:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209728:12345-0@lo:502:mount.lustre.0 Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.536194:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783138245.536243:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558944d99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138245.536261:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138245.536444:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783138245.536536:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783138245.536552:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783138245.536565:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783138245.536577:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783138245.536602:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783138245.536614:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783138245.537790:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783138245.538323:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783138245.538348:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783138245.538363:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783138245.538378:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783138245.538392:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783138245.538406:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783138245.538420:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783138245.538432:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1783138245.539598:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1783138245.539713:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1783138245.539732:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1783138245.539746:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1783138245.539758:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1783138245.539772:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1783138245.539786:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1783138245.539800:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1783138245.539813:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1783138245.539825:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1783138245.539838:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1783138245.539850:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1783138245.540541:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1783138245.540571:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1783138245.540585:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1783138245.540597:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1783138245.540626:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1783138245.541832:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1783138245.541856:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1783138245.542544:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1783138245.542564:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1783138245.542579:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1783138245.542607:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1783138245.542622:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1783138245.543988:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1783138245.544018:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1783138245.544034:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1783138245.544048:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1783138245.544063:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1783138245.544078:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1783138245.544092:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1783138245.544108:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1783138245.544210:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138245.544298:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138245.544350:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558944d99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138245.544473:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333209856 00000100:00100000:1.0:1783138245.544481:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333209856 00000100:00100000:1.0:1783138245.544535:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783138245.544545:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138245.545922:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209856:12345-0@lo:502:mount.lustre.0 Request processed in 1373us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138245.545935:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783138245.551396:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138245.551810:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1783138245.551842:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1783138245.551885:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138245.553044:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138245.553100:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9557828de000 going to sleep for 11 seconds 00000100:00100000:3.0:1783138245.558593:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333209984 00000100:00100000:3.0:1783138245.558608:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333209984 00000100:00100000:3.0:1783138245.558695:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783138245.558706:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138245.558868:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333209984:12345-0@lo:502:mount.lustre.0 Request processed in 163us (5825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.558876:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783138245.559044:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333209984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138245.559128:0:25095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1783138245.559141:0:25095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783138245.563032:0:25108:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783138245.563050:0:25108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9558b70019c0) 00000020:00000080:3.0:1783138245.563076:0:25108:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1783138245.564912:0:25108:0:(tgt_mount.c:153:server_get_mount()) get mount ffff955782aed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783138245.564921:0:25108:0:(tgt_mount.c:187:server_put_mount()) put mount ffff955782aed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783138245.564924:0:25108:0:(obd_mount.c:701:lustre_put_lsi()) put ffff955782aed800 3 00010000:00080000:3.0:1783138245.564965:0:25108:0:(ldlm_lib.c:102:import_set_conn()) imp ffff955782b95000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783138245.573042:0:25108:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1783138245.573166:0:25108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783138245.573230:0:25108:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783138245.573243:0:25108:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6bc248e9a4e97ec6 00000100:00080000:3.0:1783138245.573255:0:25108:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138245.573261:0:25108:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff955782b95000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138245.573296:0:25108:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558b6d72680 x1869755333210112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138245.573332:0:25108:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783138245.573507:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869755333210112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138245.573583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138245.577417:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333210112 00000100:00100000:3.0:1783138245.577435:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333210112 00000100:00100000:3.0:1783138245.577550:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138245.577560:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333210112:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783138245.577591:0:22771:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 714 last 0 00000020:00000080:3.0:1783138245.577712:0:22771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6bc248e9a4e97ecd 00000004:00100000:3.0:1783138245.577732:0:22771:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783138245.577773:0:22771:0:(import.c:65:import_set_state_nolock()) ffff955782b94000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138245.577868:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1869755333210112:12345-0@lo:38:llog_process_th.0 Request processed in 308us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.577876:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783138245.577936:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558b6d72680 x1869755333210112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138245.577948:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783138245.577955:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1783138245.577962:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783138245.577967:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783138245.577978:0:3644:0:(import.c:65:import_set_state_nolock()) ffff955782b95000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783138245.577986:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869755333210112:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783138245.578827:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138245.578832:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783138245.578835:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138245.578841:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 713 00000100:00080000:1.0:1783138245.578845:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783138245.578850:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9558b1ced800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783138245.578866:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578409d880 x1869755333210496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783138245.578913:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138245.578916:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783138245.578917:0:38:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138245.578922:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 713 00000100:00080000:1.0:1783138245.578924:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783138245.578928:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9558c1ec2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783138245.578936:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578409e680 x1869755333211008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138245.578993:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333210624:0@lo:400:kworker.0 00000100:00100000:1.0:1783138245.579051:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.579077:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333211264:0@lo:400:kworker.0 00000100:00100000:1.0:1783138245.579098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.579117:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783138245.579123:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333210752:0@lo:400:kworker.0 00000100:00100000:1.0:1783138245.579149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.579165:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333211392:0@lo:400:kworker.0 00000100:00100000:1.0:1783138245.579203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.579237:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333210752 00000100:00100000:1.0:1783138245.579243:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333210752 00000100:00100000:1.0:1783138245.579283:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783138245.579291:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333210752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138245.579337:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333210752:12345-0@lo:400:kworker.0 Request processed in 47us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138245.579344:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783138245.579377:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333210752:0@lo:400:kworker.0 00000100:00100000:3.0:1783138245.579621:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333210496:0@lo:8:kworker.0 00000100:00100000:3.0:1783138245.583767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138245.583833:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333211008:0@lo:8:kworker.0 00000100:00100000:3.0:1783138245.583915:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138245.583985:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333210624 00000100:00100000:3.0:1783138245.583993:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333210624 00000100:00100000:3.0:1783138245.584045:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333211264 00000100:00100000:3.0:1783138245.584049:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333211264 00000100:00100000:3.0:1783138245.584094:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333211392 00000100:00100000:3.0:1783138245.584098:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333211392 00000100:00100000:3.0:1783138245.584118:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783138245.584128:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333210624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138245.584213:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333210624:12345-0@lo:400:kworker.0 Request processed in 85us (5160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.584222:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783138245.584240:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783138245.584246:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333211264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138245.584275:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333211264:12345-0@lo:400:kworker.0 Request processed in 29us (5176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.584281:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783138245.584292:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783138245.584299:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333211392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138245.584340:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333211392:12345-0@lo:400:kworker.0 Request processed in 41us (5136us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.584354:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783138245.584401:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333210496 00000100:00100000:3.0:1783138245.584404:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333210496 00000100:00100000:3.0:1783138245.584417:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333211008 00000100:00100000:3.0:1783138245.584419:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333211008 00000100:00100000:3.0:1783138245.584434:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783138245.584438:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869755333210496:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783138245.584594:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783138245.584600:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1869755333211008:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783138245.584806:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333210368:0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.584846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.584875:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869755333211136:0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.584897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.584917:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783138245.584923:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333210240:0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.584952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.584971:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333210880:0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.584990:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.585010:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783138245.585018:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1783138245.585132:0:24278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783138245.585140:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333210368 00000100:00100000:0.0:1783138245.585144:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333210368 00000100:00100000:0.0:1783138245.585165:0:24278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783138245.585170:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333210880 00000100:00100000:0.0:1783138245.585185:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333210880 00000100:00100000:0.0:1783138245.585200:0:24278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783138245.585206:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783138245.585212:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333210368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.585252:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333210368:12345-0@lo:400:kworker.0 Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.585258:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783138245.585269:0:24278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783138245.585274:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138245.585279:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333210880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.585305:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333210880:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.585311:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138245.585327:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333211136 00000100:00100000:0.0:1783138245.585330:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333211136 00000100:00100000:0.0:1783138245.585346:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783138245.585351:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869755333211136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.585376:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869755333211136:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.585389:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783138245.585409:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333210240 00000100:00100000:0.0:1783138245.585412:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333210240 00000100:00100000:0.0:1783138245.585435:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783138245.585442:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333210240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.585595:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333210240:12345-0@lo:400:kworker.0 Request processed in 151us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.585601:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783138245.585799:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333210240:0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.585812:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333210880:0@lo:400:kworker.0 00000100:00100000:0.0:1783138245.585821:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333210368:0@lo:400:kworker.0 00010000:00080000:0.0:1783138245.585831:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95578409e300 x1869755333211136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138245.585841:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869755333211136:0@lo:400:kworker.0 00000100:00100000:3.0:1783138245.586056:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869755333210496:12345-0@lo:8:kworker.0 Request processed in 1614us (2437us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783138245.586064:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1783138245.586085:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783138245.586091:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783138245.586093:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783138245.586115:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95578409d180 x1869755333211392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138245.586126:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333211392:0@lo:400:kworker.0 00010000:00080000:3.0:1783138245.586138:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95578409f100 x1869755333210624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138245.586146:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333210624:0@lo:400:kworker.0 00010000:00080000:3.0:1783138245.586156:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95578409d500 x1869755333211264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138245.586163:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333211264:0@lo:400:kworker.0 00000100:00100000:3.0:1783138245.586204:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783138245.586211:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138245.586216:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783138245.586228:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333210496:0@lo:8:kworker.0 00000020:01000004:3.0:1783138245.586352:0:25108:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783138245.586368:0:25108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9558b7004d40) 00000100:00100000:1.0:1783138245.587823:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1869755333211008:12345-0@lo:8:kworker.0 Request processed in 3216us (3902us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783138245.587837:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:00000080:3.0:1783138245.591091:0:25108:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1783138245.591146:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783138245.591155:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138245.591162:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783138245.591166:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333211008:0@lo:8:kworker.0 00000020:01000004:3.0:1783138245.591439:0:25108:0:(tgt_mount.c:153:server_get_mount()) get mount ffff955782aed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783138245.591444:0:25108:0:(tgt_mount.c:187:server_put_mount()) put mount ffff955782aed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783138245.591448:0:25108:0:(obd_mount.c:701:lustre_put_lsi()) put ffff955782aed800 3 00010000:00080000:3.0:1783138245.592578:0:25108:0:(ldlm_lib.c:102:import_set_conn()) imp ffff955784c80000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783138245.599265:0:25108:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1783138245.599388:0:25108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1783138245.599440:0:25108:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783138245.603379:0:25108:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6bc248e9a4e97edb 00000100:00080000:3.0:1783138245.603398:0:25108:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138245.603404:0:25108:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff955784c80000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783138245.603445:0:25108:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9558b6d70a80 x1869755333211520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138245.603552:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869755333211520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783138245.603625:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783138245.605127:0:25108:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783138245.606049:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333211520 00000100:00100000:0.0:1783138245.606059:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333211520 00000100:00100000:0.0:1783138245.606103:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138245.606112:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869755333211520:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783138245.606146:0:22771:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 714 last 0 00000020:00000080:0.0:1783138245.606191:0:22771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6bc248e9a4e97ee2 00000004:00100000:0.0:1783138245.606208:0:22771:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783138245.606246:0:22771:0:(import.c:65:import_set_state_nolock()) ffff955784888000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138245.606340:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1869755333211520:12345-0@lo:38:llog_process_th.0 Request processed in 228us (2713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.606357:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783138245.607849:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9558b6d70a80 x1869755333211520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138245.607889:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783138245.607900:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1783138245.607911:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783138245.607916:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783138245.607920:0:3644:0:(import.c:65:import_set_state_nolock()) ffff955784c80000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783138245.607928:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869755333211520:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1783138245.614799:0:25108:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1783138245.614995:0:25095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783138245.615027:0:25095:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783138245.615062:0:25095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558a5596800/0x6bc248e9a4e97eb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97eb8 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138245.615074:0:25095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558a5596800/0x6bc248e9a4e97eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97eb8 expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783138245.615126:0:25095:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783138245.615129:0:25095:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783138245.615130:0:25095:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138245.615132:0:25095:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138245.615133:0:25095:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138245.615134:0:25095:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138245.615136:0:25095:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138245.615138:0:25095:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138245.615139:0:25095:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783138245.615143:0:25095:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1783138245.615145:0:25095:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138245.615147:0:25095:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783138245.615148:0:25095:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138245.615149:0:25095:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138245.615150:0:25095:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138245.615151:0:25095:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138245.615152:0:25095:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138245.615153:0:25095:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138245.615154:0:25095:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783138245.615191:0:25095:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783138245.615212:0:25095:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333211648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138245.615283:0:25095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138245.615324:0:25095:0:(client.c:2701:ptlrpc_set_wait()) set ffff9557828de780 going to sleep for 11 seconds 00000100:00100000:3.0:1783138245.616756:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333211648 00000100:00100000:3.0:1783138245.616769:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333211648 00000100:00100000:3.0:1783138245.616824:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783138245.616842:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333211648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783138245.616877:0:22764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783138245.616892:0:22764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783138245.646360:0:22764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783138245.646379:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783138245.646536:0:22787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783138245.646542:0:22787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783138245.646567:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.646588:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.646596:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.646605:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.646670:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.646684:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 24 pid: 22765 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.646698:0:22787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333211776:0@lo:104: 00000100:00100000:0.0:1783138245.646765:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783138245.646810:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.646818:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 24 pid: 22764 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.646827:0:22787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333211904:0@lo:104: 00000100:00100000:0.0:1783138245.646858:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138245.646874:0:22787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b70916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138245.646994:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333211776 00000100:00100000:1.0:1783138245.647002:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333211776 00000100:00100000:1.0:1783138245.647032:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333211904 00000100:00100000:1.0:1783138245.647034:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333211904 00000100:00100000:1.0:1783138245.647047:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138245.647054:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+4:22787:x1869755333211776:12345-0@lo:104: 00010000:00010000:1.0:1783138245.647066:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647122:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783138245.647128:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+4:22787:x1869755333211776:12345-0@lo:104: Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138245.647135:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138245.647151:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783138245.647156:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:22787:x1869755333211904:12345-0@lo:104: 00010000:00010000:1.0:1783138245.647162:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647200:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783138245.647204:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:22787:x1869755333211904:12345-0@lo:104: Request processed in 49us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138245.647216:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783138245.647231:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138245.647237:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647244:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa3000 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138245.647249:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647258:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138245.647266:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138245.647272:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783138245.647296:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647301:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138245.647321:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647327:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3000/0x6bc248e9a4e97d7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d84 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647340:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138245.647343:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647358:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa2400 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:1.0:1783138245.647362:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647368:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138245.647374:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138245.647379:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783138245.647389:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647395:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138245.647400:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647406:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e97d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d76 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138245.647418:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138245.647420:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138245.647422:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138245.647434:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333212032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138245.647473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138245.647496:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783138245.647501:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333212160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138245.647528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783138245.647688:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138245.647892:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:25095:x1869755333211648:12345-0@lo:253:mount.lustre.0 Request processed in 31052us (32608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138245.647899:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783138245.647935:0:25095:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:25095:1869755333211648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783138245.647945:0:25095:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783138245.647948:0:25095:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783138245.647950:0:25095:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783138245.647952:0:25095:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138245.647953:0:25095:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138245.647954:0:25095:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138245.647956:0:25095:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138245.647958:0:25095:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783138245.647959:0:25095:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138245.647960:0:25095:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783138245.647974:0:25095:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783138245.648577:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333212032 00000100:00100000:0.0:1783138245.648584:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333212032 00010000:00010000:0.0:1783138245.648610:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 24 pid: 22765 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.648660:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333212160 00000100:00100000:0.0:1783138245.648663:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333212160 00010000:00010000:0.0:1783138245.648673:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 25 pid: 22764 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.648692:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138245.648701:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+25:3645:x1869755333212032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138245.648712:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138245.648718:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 25 pid: 22765 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648729:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 25 pid: 22765 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648746:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138245.648785:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+25:3645:x1869755333212032:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.648791:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138245.648805:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138245.648811:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3645:x1869755333212160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138245.648818:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138245.648821:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 24 pid: 22764 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648839:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 24 pid: 22764 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648852:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648861:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783138245.648876:0:22757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009479714s 00010000:00010000:0.0:1783138245.648881:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648888:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648894:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648901:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648907:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a5597600 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138245.648911:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648919:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648929:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.648944:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138245.648969:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3645:x1869755333212160:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138245.648975:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1783138245.649098:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e97d84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97d7d expref: 23 pid: 22765 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.649110:0:22787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333211776:0@lo:104: 00010000:00010000:0.0:1783138245.649121:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b6fa3800/0x6bc248e9a4e97d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97d6f expref: 22 pid: 22764 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.649128:0:22787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22787:1869755333211904:0@lo:104: 00010000:00010000:0.0:1783138245.649149:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.649159:0:22787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.649165:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138245.649203:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558a5597600/0x6bc248e9a4e97ee9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138245.649233:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333212160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138245.649241:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333212032:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1783138245.653938:0:25095:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1783138245.663093:0:25095:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783138245.663108:0:25095:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783138245.663154:0:25095:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783138245.663214:0:25095:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783138245.663233:0:25095:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1783138245.663261:0:25095:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1783138245.665049:0:25095:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783138245.665624:0:25095:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783138245.698646:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783138246.593480:0:25163:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783138246.593973:0:25163:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783138246.708889:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783138246.846199:0:23528:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1783138247.029838:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783138247.029846:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9557828c9000 from 14 10000000:01000000:1.0:1783138247.029852:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783138247.029900:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e97ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.029911:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e97ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.029922:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e97ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138247.029952:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333212288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138247.030025:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138247.030067:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b94fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138247.030088:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333212288 00000100:00100000:1.0:1783138247.030095:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333212288 00000100:00100000:1.0:1783138247.030157:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783138247.030168:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:22768:x1869755333212288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138247.030182:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138247.030195:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95588302a600/0x6bc248e9a4e97ef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97ef0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.030218:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95588302a600/0x6bc248e9a4e97ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ef0 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.030229:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95588302a600/0x6bc248e9a4e97ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ef0 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.030253:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302a600, rc 0) 00000100:00100000:1.0:1783138247.030293:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333212288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138247.030300:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783138247.031164:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333212288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138247.031183:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e97ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ef7 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.031194:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e97ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97ef7 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138247.031248:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333212416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783138247.031288:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138247.031314:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b94fde40 going to sleep for 11 seconds 00000100:00100000:2.0:1783138247.031696:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333212416 00000100:00100000:2.0:1783138247.031702:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333212416 00000100:00100000:2.0:1783138247.031739:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783138247.031748:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333212416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138247.031767:0:22764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138247.031784:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138247.031787:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783138247.031867:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333212416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138247.031876:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783138247.032349:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333212416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783138247.032417:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783138247.032425:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e97ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ef7 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.032434:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302b400/0x6bc248e9a4e97ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97ef7 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138247.032444:0:22768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783138247.032447:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9558b1cfd000 from 14 10000000:01000000:1.0:1783138247.032449:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783138247.032474:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302a400/0x6bc248e9a4e97efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.032488:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff95588302a400/0x6bc248e9a4e97efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.032497:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff95588302a400/0x6bc248e9a4e97efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138247.032513:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333212544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138247.032545:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138247.032561:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b94fde40 going to sleep for 11 seconds 00000100:00100000:2.0:1783138247.032662:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333212544 00000100:00100000:2.0:1783138247.032668:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333212544 00000100:00100000:2.0:1783138247.032700:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783138247.032708:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333212544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138247.032718:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138247.032731:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558a573a800/0x6bc248e9a4e97f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e97efe expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138247.032751:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558a573a800/0x6bc248e9a4e97f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e97efe expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138247.032762:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558a573a800/0x6bc248e9a4e97f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97efe expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138247.032771:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558a573a800, rc 0) 00000100:00100000:2.0:1783138247.032800:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:22768:x1869755333212544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138247.032807:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783138247.033225:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333212544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138247.033238:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff95588302a400/0x6bc248e9a4e97efe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97f05 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.033247:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff95588302a400/0x6bc248e9a4e97efe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e97f05 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138247.033296:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333212672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783138247.033329:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138247.033351:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b94fde40 going to sleep for 11 seconds 00000100:00100000:2.0:1783138247.033402:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333212672 00000100:00100000:2.0:1783138247.033413:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333212672 00000100:00100000:2.0:1783138247.033446:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783138247.033453:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:22768:x1869755333212672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138247.033466:0:22766:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138247.033482:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138247.033485:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783138247.033553:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:22768:x1869755333212672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138247.033561:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783138247.034897:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333212672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783138247.034963:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783138247.034972:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff95588302a400/0x6bc248e9a4e97efe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97f05 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138247.034980:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff95588302a400/0x6bc248e9a4e97efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e97f05 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138247.736037:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138248.759863:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138248.820824:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333212800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783138248.820896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138248.820994:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333212800 00000100:00100000:0.0:1783138248.821002:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333212800 00000100:00100000:0.0:1783138248.821070:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138248.821081:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333212800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138248.821123:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138248.821184:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333212800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138248.821191:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783138248.821338:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138248.821378:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333212800:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783138249.787398:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138249.846212:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783138249.846238:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333212928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138249.846315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138249.846374:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333212928 00000100:00100000:0.0:1783138249.846381:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333212928 00000100:00100000:0.0:1783138249.846428:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783138249.846436:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333212928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783138249.846475:0:23513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138249.846519:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333212928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138249.846526:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783138249.846570:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333212928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138249.853698:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783138249.853724:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333213056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783138249.853799:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138249.853854:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333213056 00000100:00100000:2.0:1783138249.853861:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333213056 00000100:00100000:2.0:1783138249.853919:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138249.853929:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333213056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783138249.853959:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783138249.854004:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333213056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138249.854012:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138249.854300:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333213056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783138249.854321:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333213184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138249.854347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783138249.854432:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138249.854432:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333213184 00000100:00100000:0.0:1783138249.854437:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333213184 00000100:00100000:0.0:1783138249.854515:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783138249.854524:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333213184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783138249.854555:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783138249.854599:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333213184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138249.854617:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783138249.854674:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333213184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783138250.809828:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138250.869044:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138250.869052:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783138250.869056:0:8:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138250.869069:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9558b1ced800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783138250.869103:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578409f800 x1869755333213696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783138250.869136:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138250.869139:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783138250.869141:0:8:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138250.869145:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9558c1ec2000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783138250.869155:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95578409c380 x1869755333214208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138250.869210:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333213568:0@lo:400:kworker.0 00000100:00100000:1.0:1783138250.869284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.869332:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333214336:0@lo:400:kworker.0 00000100:00100000:1.0:1783138250.869358:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.869375:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869755333214848:0@lo:400:kworker.0 00000100:00100000:1.0:1783138250.869412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.869438:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783138250.869444:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869755333213824:0@lo:400:kworker.0 00000100:00100000:1.0:1783138250.869464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.869481:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333214464:0@lo:400:kworker.0 00000100:00100000:1.0:1783138250.869501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.869523:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333213696:0@lo:8:kworker.0 00000100:00100000:2.0:1783138250.869650:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333213312:0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.869689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138250.869718:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333213952:0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.869740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138250.869757:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333214592:0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.869775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138250.869786:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783138250.869791:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333213440:0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.869811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138250.869827:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333214080:0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.869847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138250.869860:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869755333214720:0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.869878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138250.869918:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333214336 00000100:00100000:2.0:1783138250.869932:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333214336 00000100:00100000:2.0:1783138250.869979:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333214848 00000100:00100000:2.0:1783138250.869987:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333214848 00000100:00100000:2.0:1783138250.870013:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333213824 00000100:00100000:2.0:1783138250.870016:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333213824 00000100:00100000:2.0:1783138250.870027:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333214464 00000100:00100000:2.0:1783138250.870029:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333214464 00000100:00100000:2.0:1783138250.870040:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333214592 00000100:00100000:2.0:1783138250.870043:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333214592 00000100:00100000:2.0:1783138250.870052:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333214720 00000100:00100000:2.0:1783138250.870054:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333214720 00000100:00100000:2.0:1783138250.870068:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783138250.870076:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333214336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870146:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869755333214336:12345-0@lo:400:kworker.0 Request processed in 71us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870162:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783138250.870179:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783138250.870185:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869755333214848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870214:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869755333214848:12345-0@lo:400:kworker.0 Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870220:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783138250.870231:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783138250.870236:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869755333213824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870260:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869755333213824:12345-0@lo:400:kworker.0 Request processed in 25us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870265:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783138250.870275:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783138250.870280:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333214464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870322:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333214464:12345-0@lo:400:kworker.0 Request processed in 42us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870327:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783138250.870338:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783138250.870344:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333214592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870372:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333214592:12345-0@lo:400:kworker.0 Request processed in 28us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870378:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783138250.870387:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138250.870392:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869755333214720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870416:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869755333214720:12345-0@lo:400:kworker.0 Request processed in 24us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870428:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138250.870451:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333213312 00000100:00100000:2.0:1783138250.870455:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333213312 00000100:00100000:2.0:1783138250.870480:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783138250.870486:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3647:x1869755333213312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870514:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3647:x1869755333213312:12345-0@lo:400:kworker.0 Request processed in 28us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870520:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783138250.870560:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333213952 00000100:00100000:2.0:1783138250.870563:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333213952 00000100:00100000:2.0:1783138250.870585:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333213440 00000100:00100000:2.0:1783138250.870588:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333213440 00000100:00100000:2.0:1783138250.870600:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783138250.870606:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333213952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870657:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333213952:12345-0@lo:400:kworker.0 Request processed in 52us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870664:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783138250.870675:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783138250.870680:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333213440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870705:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333213440:12345-0@lo:400:kworker.0 Request processed in 25us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.870709:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1783138250.870726:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783138250.870730:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783138250.870763:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333213440:0@lo:400:kworker.0 00010000:00080000:2.0:1783138250.870774:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9558b17c5180 x1869755333214720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138250.870790:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869755333214720:0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870799:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333213312:0@lo:400:kworker.0 00000100:00100000:2.0:1783138250.870808:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333213952:0@lo:400:kworker.0 00010000:00080000:2.0:1783138250.870816:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9558b17c6d80 x1869755333214592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138250.870824:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333214592:0@lo:400:kworker.0 00010000:00080000:2.0:1783138250.870862:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95578409ed80 x1869755333213824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138250.870870:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869755333213824:0@lo:400:kworker.0 00010000:00080000:2.0:1783138250.870889:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9558b17c6300 x1869755333214464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138250.870897:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333214464:0@lo:400:kworker.0 00010000:00080000:2.0:1783138250.870908:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95578409ea00 x1869755333214336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138250.870921:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869755333214336:0@lo:400:kworker.0 00010000:00080000:2.0:1783138250.870936:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff955889518380 x1869755333214848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138250.870951:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869755333214848:0@lo:400:kworker.0 00000100:00100000:1.0:1783138250.871136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.871168:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333214208:0@lo:8:kworker.0 00000100:00100000:1.0:1783138250.871195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.871229:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333213568 00000100:00100000:1.0:1783138250.871233:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333213568 00000100:00100000:1.0:1783138250.871259:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333214080 00000100:00100000:1.0:1783138250.871262:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333214080 00000100:00100000:1.0:1783138250.871279:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333213696 00000100:00100000:1.0:1783138250.871282:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333213696 00000100:00100000:1.0:1783138250.871290:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333214208 00000100:00100000:1.0:1783138250.871292:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333214208 00000100:00100000:1.0:1783138250.871301:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138250.871308:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333213568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138250.871347:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333213568:12345-0@lo:400:kworker.0 Request processed in 40us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138250.871353:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138250.871365:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783138250.871372:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333214080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138250.871399:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333214080:12345-0@lo:400:kworker.0 Request processed in 29us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138250.871416:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783138250.871428:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138250.871432:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1869755333213696:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783138250.871476:0:24278:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:1.0:1783138250.871504:0:24278:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6bc248e9a4e97f0c 00002000:00100000:1.0:1783138250.871520:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff955782924000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783138250.871525:0:24278:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783138250.871527:0:24278:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1783138250.873033:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783138250.873046:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1869755333214208:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783138250.873113:0:24753:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1783138250.873141:0:24753:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6bc248e9a4e97f13 00002000:00100000:2.0:1783138250.873156:0:24753:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9558bd9cd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1783138250.873160:0:24753:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1783138250.873162:0:24753:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783138250.873346:0:24753:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1783138250.873373:0:24753:0:(import.c:65:import_set_state_nolock()) ffff9558bd9cc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138250.873466:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1869755333214208:12345-0@lo:8:kworker.0 Request processed in 419us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.873475:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1783138250.873516:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1783138250.873680:0:24278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783138250.873695:0:24278:0:(import.c:65:import_set_state_nolock()) ffff955782921800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138250.873729:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1869755333213696:12345-0@lo:8:kworker.0 Request processed in 2295us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138250.873736:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783138250.873989:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333213568:0@lo:400:kworker.0 00000100:00100000:3.0:1783138250.874034:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333214080:0@lo:400:kworker.0 00010000:00080000:2.0:1783138250.874337:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95578409c380 x1869755333214208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138250.874353:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1783138250.874363:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783138250.874370:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783138250.874373:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558c1ec2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783138250.874435:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783138250.874441:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869755333214208:0@lo:8:kworker.0 00000004:00080000:1.0:1783138250.880920:0:23517:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783138250.880956:0:23517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1869755333215104:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1783138250.881032:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.881067:0:23517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b10b2480 going to sleep for 11 seconds 00000100:00100000:2.0:1783138250.884864:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95588951b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333214976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138250.884952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138250.885021:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333214976 00000100:00100000:2.0:1783138250.885029:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333214976 00000100:00100000:2.0:1783138250.885100:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138250.885112:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869755333214976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783138250.885146:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1783138250.885203:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869755333214976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138250.885210:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1783138250.885233:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783138250.885264:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95588951b480 x1869755333214976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138250.885285:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95588951b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333214976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138250.885321:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333215104 00000100:00100000:2.0:1783138250.885325:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333215104 00000100:00100000:2.0:1783138250.885352:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138250.885357:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23517:x1869755333215104:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783138250.886807:0:23516:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783138250.886939:0:23516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 719858308251ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783138250.886948:0:23516:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:3.0:1783138250.887010:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95578409f800 x1869755333213696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783138250.887030:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1783138250.887041:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783138250.887048:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783138250.887052:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9558b1ced800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783138250.887075:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783138250.887090:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869755333213696:0@lo:8:kworker.0 00000004:00080000:2.0:1783138250.887228:0:22798:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1783138250.887250:0:22798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22798:1869755333215360:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783138250.887322:0:22798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138250.887354:0:22798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1f8a0c0 going to sleep for 11 seconds 00000004:00080000:2.0:1783138250.887366:0:22797:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783138250.887414:0:22797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719858784434ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783138250.887419:0:22797:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783138250.888861:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783138250.888886:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557842d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333215232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783138250.888965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138250.889027:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333215232 00000100:00100000:3.0:1783138250.889036:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333215232 00000100:00100000:3.0:1783138250.889109:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783138250.889119:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869755333215232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783138250.889144:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783138250.889204:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869755333215232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138250.889211:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1783138250.889234:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783138250.889260:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9557842d5500 x1869755333215232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138250.889278:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333215232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783138250.889330:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333215360 00000100:00100000:3.0:1783138250.889349:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333215360 00000100:00100000:3.0:1783138250.889390:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783138250.889397:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22798:x1869755333215360:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783138250.891445:0:24753:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783138250.891457:0:24753:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783138250.891560:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23517:x1869755333215104:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6198us (10525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138250.891570:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783138250.892256:0:23517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff955889519180 x1869755333215104/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783138266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138250.892273:0:23517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1869755333215104:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1783138250.892287:0:23517:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1783138250.892348:0:23517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1869755333215488:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1783138250.892405:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.892434:0:23517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b10b2480 going to sleep for 11 seconds 00000100:00100000:3.0:1783138250.892661:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333215488 00000100:00100000:3.0:1783138250.892668:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333215488 00000100:00100000:3.0:1783138250.892939:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783138250.892951:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23517:x1869755333215488:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783138250.892988:0:24280:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1783138250.893038:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23517:x1869755333215488:12345-0@lo:5:osp-pre-1-1.0 Request processed in 89us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138250.893046:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1783138250.893109:0:23517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff955889519180 x1869755333215488/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783138266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138250.893121:0:23517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1869755333215488:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1783138250.893131:0:23517:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1783138250.893161:0:23517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1869755333215616:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1783138250.893185:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138250.893206:0:23517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b10b2480 going to sleep for 11 seconds 00000100:00100000:3.0:1783138250.893354:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333215616 00000100:00100000:3.0:1783138250.893359:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333215616 00000100:00100000:3.0:1783138250.893385:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783138250.893391:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23517:x1869755333215616:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783138250.893418:0:24279:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:1.0:1783138250.901889:0:23505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1783138250.910487:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1783138250.916675:0:24278:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783138250.916686:0:24278:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1783138250.916692:0:24278:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:2.0:1783138250.926102:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.926115:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.926133:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.926138:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.926145:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.926175:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.926186:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.926195:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.926254:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138250.929094:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.929106:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.929123:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.929128:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.929134:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.929148:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.929159:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.929178:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.930808:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138250.930821:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.930834:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573ac00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138250.930840:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.930852:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.930887:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.930895:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.931144:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138250.931157:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.931164:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573b000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138250.931168:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.931176:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.931187:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.931194:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138250.931195:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138250.931197:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.938667:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783138250.938682:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783138250.939696:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.939705:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.939720:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.939724:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.939729:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.939743:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.939753:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.939761:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.942687:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138250.942704:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.942717:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573bc00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138250.942722:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.942733:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.942756:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138250.942783:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138250.942784:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138250.942786:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.952663:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783138250.952678:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783138250.953263:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.953270:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953284:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.953289:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.953295:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953309:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953319:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953327:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953355:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138250.953651:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.953659:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.953668:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573a000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.953674:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.953685:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.953707:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.953715:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97f2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.953733:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.953736:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.953738:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.953839:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.953844:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953858:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.953861:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.953865:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953873:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953881:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953888:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.953906:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138250.954706:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.954714:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.954730:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573b200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.954734:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.954742:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.954756:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.954763:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97f36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.954781:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.954782:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.954783:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.954884:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.954892:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.954901:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.954904:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.954909:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.954919:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.954938:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.954945:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.955203:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138250.955553:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.955559:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.955568:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.955570:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.955575:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.955583:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.955591:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.955598:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955743:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138250.955749:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955757:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573aa00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.955761:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955769:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955787:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955795:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955810:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.955813:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955820:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573ae00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.955822:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955829:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955837:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.955845:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.955846:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.955848:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138250.955889:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.957939:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783138250.957953:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783138250.958213:0:25096:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1783138250.958227:0:25096:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783138250.958253:0:25096:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1783138250.958300:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138250.958453:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23517:x1869755333215616:12345-0@lo:5:osp-pre-1-1.0 Request processed in 65058us (65264us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1783138250.958465:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138250.959208:0:23517:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1783138250.959218:0:23517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1869755333215616:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783138250.959233:0:23517:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1783138250.959296:0:23517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23517:1869755333215744:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783138250.959344:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783138250.960576:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.960588:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.960606:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.960610:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.960617:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.960648:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.960658:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.960666:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.960684:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783138250.960984:0:23517:0:(client.c:2701:ptlrpc_set_wait()) set ffff955888ba7780 going to sleep for 11 seconds 00002000:00010000:2.0:1783138250.961908:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.961917:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.961948:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.961952:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.961964:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962180:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962192:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962200:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962227:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783138250.962565:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138250.962573:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962582:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573b000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.962587:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962597:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962614:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962622:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97f4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962663:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.962667:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962680:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573be00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.962683:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962690:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962701:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962707:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97f52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.962720:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.962722:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.962723:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.962861:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.962866:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962875:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.962878:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.962883:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962892:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962911:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962918:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.962938:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138250.963766:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.963774:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.963784:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.963788:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.963792:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.963803:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.963811:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.963819:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.963839:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783138250.964037:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138250.964043:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964051:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573a200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.964056:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964064:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964094:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964101:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97f59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964114:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.964117:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964123:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573a400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.964126:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964133:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964142:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964148:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97f60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964156:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.964157:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.964164:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.964538:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.964602:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.964612:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.964615:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.964621:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.964685:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.964695:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.964702:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.964718:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138250.964930:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.964936:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964944:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573b600 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.964948:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.964956:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.965103:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.965111:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016da4f81/0x6bc248e9a4e97f67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.965128:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.965129:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.965131:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.967054:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.967427:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.967437:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.967451:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.967468:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.967474:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.967487:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.967496:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.967503:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.967530:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783138250.967669:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333215744 00000100:00100000:1.0:1783138250.967679:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333215744 00000100:00100000:1.0:1783138250.967729:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138250.967738:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23517:x1869755333215744:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783138250.967835:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23517:x1869755333215744:12345-0@lo:900:osp-pre-1-1.0 Request processed in 98us (8490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138250.967844:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783138250.967886:0:23517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9558ace4a300 x1869755333215744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783138266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138250.967900:0:23517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23517:1869755333215744:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1783138250.969217:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1783138250.969718:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.969728:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.969743:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.969747:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.969753:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.969766:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.969777:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.969791:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.969814:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138250.969988:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.969998:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573ba00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.970002:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970017:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970033:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970040:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760b1919/0x6bc248e9a4e97f6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970058:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.970061:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970067:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573ae00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.970070:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970076:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970095:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970102:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822be06b/0x6bc248e9a4e97f75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.970125:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.970127:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.970129:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.970135:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.970709:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.970718:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.970728:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.970731:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.970737:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.970746:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.970756:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.970763:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.970780:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138250.971663:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.971672:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.971683:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573bc00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.971688:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.971700:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.971717:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.971723:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ee7542e/0x6bc248e9a4e97f7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.971748:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.971751:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.971752:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.977921:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.977939:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.977979:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.977984:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.977991:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978007:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978018:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978027:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978054:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138250.978732:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.978740:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978750:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.978753:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.978757:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978768:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978788:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978796:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978812:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783138250.978822:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138250.978828:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978835:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573b800 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.978840:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978849:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978866:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978874:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12f068b/0x6bc248e9a4e97f83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978892:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138250.978901:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978908:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573b400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.978912:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978919:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978929:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978936:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054165b7e/0x6bc248e9a4e97f8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.978948:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.978950:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.978951:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.979802:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.979811:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979822:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.979826:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.979831:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979853:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979863:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979869:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979883:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138250.979892:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138250.979895:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979902:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573a600 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.979905:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979912:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979924:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979930:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081c1888a/0x6bc248e9a4e97f91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.979952:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.979954:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.979956:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.980512:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.980519:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980528:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.980531:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.980535:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980596:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980606:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980613:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980649:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138250.980657:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138250.980661:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980680:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573ac00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.980683:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980692:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980704:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980711:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a633513/0x6bc248e9a4e97f98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.980727:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.980729:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.980731:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.981213:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.981781:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.981790:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.981802:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.981805:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.981810:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.981821:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.981837:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.981844:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.981865:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138250.983584:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.983605:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.983617:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573aa00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.983622:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.983654:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.983678:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.983686:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9b784c/0x6bc248e9a4e97f9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.983859:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.983861:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.983863:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.984277:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.984287:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.984299:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.984304:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.984310:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.984322:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.984331:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.984340:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.984377:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138250.986072:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.986216:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986233:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.986237:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.986243:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986255:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986264:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986272:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986297:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783138250.986313:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138250.986319:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986327:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573b200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.986344:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986353:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986369:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986376:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069306708/0x6bc248e9a4e97fa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986394:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138250.986397:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986403:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573a000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.986406:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986413:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986422:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986429:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001e152fe/0x6bc248e9a4e97fad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.986446:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.986448:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.986450:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.986678:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.987177:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.987184:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.987195:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.987198:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.987203:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.987213:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.987221:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.987229:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.987280:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138250.987991:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.988000:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.988022:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.988026:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.988030:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.988041:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.988050:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.988057:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.991697:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138250.991712:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.991725:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573a400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.991731:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.991760:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.991781:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.991789:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba38432/0x6bc248e9a4e97fb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.991940:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138250.991957:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138250.991973:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.993737:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573a200 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.993744:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.993755:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.993794:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.993801:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c5e428/0x6bc248e9a4e97fbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.993828:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.993830:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.993832:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.995499:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.995512:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.995528:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.995532:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.995538:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996069:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996089:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996162:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996195:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138250.996209:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138250.996215:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996223:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573be00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.996228:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996236:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996255:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996262:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069db6410/0x6bc248e9a4e97fc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996284:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.996287:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.996289:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.996740:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.996747:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996757:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.996767:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.996772:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996783:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996792:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996799:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996815:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138250.996824:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138250.996827:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996835:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a573b000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.996838:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996846:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996857:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996875:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004994665e/0x6bc248e9a4e97fc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.996889:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.996891:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.996893:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.997993:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.998004:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998016:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.998019:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.998025:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998036:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998045:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998052:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998068:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138250.998088:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138250.998171:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998179:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba1400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138250.998182:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998190:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.998267:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.998312:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998320:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026bd5659/0x6bc248e9a4e97fd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998336:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.998337:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138250.998339:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.998842:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.998850:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998858:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.998861:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.998866:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998887:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998895:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998901:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.998922:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138250.999270:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.999277:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999285:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0600 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.999288:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999296:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999308:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999315:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0aeadf4/0x6bc248e9a4e97fd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999338:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.999339:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.999341:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.999410:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.999416:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.999424:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.999426:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.999431:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.999439:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.999447:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.999464:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.999486:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138250.999608:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138250.999613:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999620:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba1000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138250.999624:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999652:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999663:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999670:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055a64bb1/0x6bc248e9a4e97fde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138250.999683:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.999685:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138250.999687:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138250.999947:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138250.999952:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.999972:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138250.999975:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138250.999979:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.999988:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138250.999996:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138251.000002:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138251.000163:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138251.002431:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138251.002445:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138251.002473:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1783138251.002477:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138251.002483:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138251.002498:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138251.002508:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138251.002516:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002594:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138251.002601:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002621:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0c00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138251.002625:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002650:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002667:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002675:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c973bf79/0x6bc248e9a4e97fe5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002693:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138251.002696:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002702:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba1c00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138251.002706:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002713:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002723:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138251.002736:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138251.002737:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138251.002740:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138251.004359:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783138251.004371:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079d62308/0x6bc248e9a4e97fec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783138251.004481:0:24278:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00010000:00010000:0.0:1783138251.004626:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138251.004712:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22798:x1869755333215360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 115312us (117386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138251.004723:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783138251.004818:0:22798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557842d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22798:1869755333215360:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783138251.004835:0:22798:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1783138251.004883:0:22798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22798:1869755333215872:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783138251.004920:0:22798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138251.004944:0:22798:0:(client.c:2701:ptlrpc_set_wait()) set ffff955888ba7780 going to sleep for 11 seconds 00000100:00100000:1.0:1783138251.007950:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333215872 00000100:00100000:1.0:1783138251.007970:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333215872 00000100:00100000:1.0:1783138251.008051:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138251.008062:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22798:x1869755333215872:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783138251.008123:0:24280:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1783138251.014322:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22798:x1869755333215872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6251us (9390us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783138251.014337:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783138251.014405:0:22798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22798:1869755333215872:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783138251.014422:0:22798:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000040:00080000:2.0:1783138251.126711:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783138251.836257:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783138251.886214:0:25452:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1783138252.832917:0:25505:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783138252.834412:0:25505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138252.855758:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783138253.710069:0:25555:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783138253.710361:0:25555:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138253.876868:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138253.946735:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783138253.946758:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333216000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138253.946828:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138253.946876:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333216000 00000100:00100000:0.0:1783138253.946883:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333216000 00000100:00100000:0.0:1783138253.946960:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138253.946971:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333216000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138253.947010:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138253.947067:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333216000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138253.947074:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1783138253.947098:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138253.947141:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333216000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138253.972319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138253.972392:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311080960 00000100:00100000:1.0:1783138253.972402:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311080960 00000100:00100000:1.0:1783138253.972444:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:1.0:1783138253.972452:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2408:x1869755311080960:12345-192.168.201.6@tcp:250:mount.lustre.0 00010000:00080000:1.0:1783138253.972479:0:22765:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9768c8db-2837-4b37-8344-aa5fc6411a75@192.168.201.6@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:1.0:1783138253.972507:0:22765:0:(genops.c:1406:class_connect()) connect: client 9768c8db-2837-4b37-8344-aa5fc6411a75, cookie 0x6bc248e9a4e97ff3 00000100:00080000:1.0:1783138253.972666:0:22765:0:(import.c:65:import_set_state_nolock()) ffff955782924800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138253.972737:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+5:2408:x1869755311080960:12345-192.168.201.6@tcp:250:mount.lustre.0 Request processed in 284us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138253.972746:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:0.0:1783138254.006752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138254.007086:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311081088 00000100:00100000:2.0:1783138254.007097:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311081088 00000100:00100000:2.0:1783138254.007158:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:2.0:1783138254.007181:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+5:18078:x1869755311081088:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138254.007198:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138254.007216:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff955783ba1600/0x6bc248e9a4e97ffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b968bd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138254.007246:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff955783ba1600/0x6bc248e9a4e97ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968bd expref: 6 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138254.007257:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff955783ba1600/0x6bc248e9a4e97ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968bd expref: 6 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138254.007267:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba1600, rc 0) 00000100:00100000:2.0:1783138254.007344:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+6:18078:x1869755311081088:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 165us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138254.007352:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:3.0:1783138254.012043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.012191:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311081216 00000100:00100000:1.0:1783138254.012201:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311081216 00000100:00100000:1.0:1783138254.012258:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:1.0:1783138254.012269:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+6:18078:x1869755311081216:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783138254.012398:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+6:18078:x1869755311081216:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 130us (376us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783138254.012407:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:0.0:1783138254.016373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.016458:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311081344 00000100:00100000:1.0:1783138254.016467:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311081344 00000100:00100000:1.0:1783138254.016529:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:1.0:1783138254.016539:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+6:18078:x1869755311081344:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783138254.016557:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138254.016577:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95588302a200/0x6bc248e9a4e98001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b968c4 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.016662:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95588302a200/0x6bc248e9a4e98001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968c4 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.016674:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95588302a200/0x6bc248e9a4e98001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968c4 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.016683:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302a200, rc 0) 00000100:00100000:1.0:1783138254.016741:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+7:18078:x1869755311081344:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 202us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.016749:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:0.0:1783138254.022958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.023127:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311081472 00000100:00100000:1.0:1783138254.023140:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311081472 00000100:00100000:1.0:1783138254.023209:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:1.0:1783138254.023219:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+7:18078:x1869755311081472:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783138254.023422:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18078:x1869755311081472:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 203us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.023430:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:3.0:1783138254.037755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.038248:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311081600 00000100:00100000:1.0:1783138254.038261:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311081600 00000100:00100000:1.0:1783138254.038336:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:1.0:1783138254.038348:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18078:x1869755311081600:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783138254.038511:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18078:x1869755311081600:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 165us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.038520:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:0.0:1783138254.042077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.042129:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311081728 00000100:00100000:1.0:1783138254.042151:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311081728 00000100:00100000:1.0:1783138254.042207:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:1.0:1783138254.042218:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18097:x1869755311081728:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138254.042362:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18097:x1869755311081728:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 146us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.042371:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:0.0:1783138254.077755:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.077850:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311081856 00000100:00100000:1.0:1783138254.077860:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311081856 00000100:00100000:1.0:1783138254.078081:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:1.0:1783138254.078093:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18097:x1869755311081856:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138254.078288:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18097:x1869755311081856:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 197us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.078297:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:3.0:1783138254.098071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138254.098412:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311081984 00000100:00100000:2.0:1783138254.098425:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311081984 00000100:00100000:2.0:1783138254.098491:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:2.0:1783138254.098510:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18097:x1869755311081984:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138254.098700:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18097:x1869755311081984:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 191us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138254.098709:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:2.0:1783138254.108735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.109191:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311082112 00000100:00100000:1.0:1783138254.109201:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311082112 00000100:00100000:1.0:1783138254.109270:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:1.0:1783138254.109282:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+8:18078:x1869755311082112:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783138254.109301:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138254.109442:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95588302ac00/0x6bc248e9a4e98008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b968f5 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.109477:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95588302ac00/0x6bc248e9a4e98008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968f5 expref: 9 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.109489:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95588302ac00/0x6bc248e9a4e98008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968f5 expref: 9 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.109528:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302ac00, rc 0) 00000100:00100000:1.0:1783138254.109691:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+9:18078:x1869755311082112:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 411us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.109699:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:0.0:1783138254.113113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.113276:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311082240 00000100:00100000:1.0:1783138254.113285:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311082240 00000100:00100000:1.0:1783138254.113398:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:1.0:1783138254.113409:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+9:18078:x1869755311082240:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783138254.113438:0:22765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783138254.113465:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783138254.113469:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783138254.113473:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783138254.113476:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783138254.113478:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1783138254.115518:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+9:18078:x1869755311082240:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 2100us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.115532:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:3.0:1783138254.119608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.119843:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311082368 00000100:00100000:1.0:1783138254.119855:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311082368 00000100:00100000:1.0:1783138254.120159:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:1.0:1783138254.120172:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+9:18078:x1869755311082368:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783138254.120192:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138254.120212:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b968fc expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.120248:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 10 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.120278:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 10 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.120290:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302b200, rc 0) 00000100:00100000:1.0:1783138254.120401:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18078:x1869755311082368:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 231us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.120408:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:0.0:1783138254.122271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.122391:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311082496 00000100:00100000:1.0:1783138254.122401:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311082496 00000100:00100000:1.0:1783138254.122514:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:1.0:1783138254.122537:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558c1e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18078:x1869755311082496:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783138254.122753:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558c1e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18078:x1869755311082496:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 219us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.122762:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:3.0:1783138254.124575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138254.124720:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311082624 00000100:00100000:2.0:1783138254.124731:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311082624 00000100:00100000:2.0:1783138254.124795:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:2.0:1783138254.124808:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6953850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18078:x1869755311082624:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783138254.125017:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6953850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18078:x1869755311082624:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 210us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138254.125034:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:3.0:1783138254.129855:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.130003:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311082752 00000100:00100000:1.0:1783138254.130015:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311082752 00000100:00100000:1.0:1783138254.130093:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:1.0:1783138254.130105:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6951450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18102:x1869755311082752:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138254.130287:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6951450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18102:x1869755311082752:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 183us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.130296:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:0.0:1783138254.136783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.137009:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311082880 00000100:00100000:1.0:1783138254.137032:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311082880 00000100:00100000:1.0:1783138254.137102:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:1.0:1783138254.137113:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6952450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18102:x1869755311082880:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138254.137309:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6952450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18102:x1869755311082880:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 196us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.137319:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:3.0:1783138254.142786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138254.142996:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311083008 00000100:00100000:2.0:1783138254.143010:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311083008 00000100:00100000:2.0:1783138254.143080:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:2.0:1783138254.143090:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1869755311083008:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783138254.143124:0:24301:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 92abdb97-8e98-4553-a110-233a98850940@192.168.201.6@tcp t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:2.0:1783138254.143182:0:24301:0:(genops.c:1406:class_connect()) connect: client 92abdb97-8e98-4553-a110-233a98850940, cookie 0x6bc248e9a4e98016 00000004:00100000:2.0:1783138254.143210:0:24301:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783138254.143443:0:24301:0:(import.c:65:import_set_state_nolock()) ffff9558bd9cf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138254.143561:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+6:2408:x1869755311083008:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 470us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138254.143570:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1783138254.160233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138254.160284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138254.160688:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311083136 00000100:00100000:0.0:1783138254.160701:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311083136 00000100:00100000:0.0:1783138254.160801:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311083520 00000100:00100000:0.0:1783138254.160804:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311083520 00000100:00100000:0.0:1783138254.160834:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1783138254.160845:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+7:2412:x1869755311083136:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783138254.160902:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138254.161013:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+7:2412:x1869755311083136:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 169us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138254.161033:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1783138254.161054:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:0.0:1783138254.161062:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+6:18078:x1869755311083520:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783138254.161093:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138254.161117:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+6:18078:x1869755311083520:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 56us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138254.161124:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:3.0:1783138254.161726:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138254.166032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138254.166144:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311083264 00000100:00100000:0.0:1783138254.166156:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311083264 00000100:00100000:0.0:1783138254.166264:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1783138254.166273:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1869755311083264:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783138254.166311:0:22772:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 92abdb97-8e98-4553-a110-233a98850940@192.168.201.6@tcp t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:0.0:1783138254.166380:0:22772:0:(genops.c:1406:class_connect()) connect: client 92abdb97-8e98-4553-a110-233a98850940, cookie 0x6bc248e9a4e9801d 00000004:00100000:0.0:1783138254.166410:0:22772:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783138254.166696:0:22772:0:(import.c:65:import_set_state_nolock()) ffff955782aec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138254.166788:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+6:2408:x1869755311083264:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 515us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138254.166798:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1783138254.173329:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.173425:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311083392 00000100:00100000:1.0:1783138254.173438:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311083392 00000100:00100000:1.0:1783138254.173523:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1783138254.173543:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+6:0:x1869755311083392:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783138254.173587:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138254.173703:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+6:0:x1869755311083392:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 165us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.173711:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00080000:3.0:1783138254.174004:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783138254.179570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138254.180471:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311083648 00000100:00100000:2.0:1783138254.180495:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311083648 00000100:00100000:2.0:1783138254.180576:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1783138254.180587:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+6:18078:x1869755311083648:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783138254.180751:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+6:18078:x1869755311083648:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 165us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138254.180759:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1783138254.184556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138254.184594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138254.184625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.184782:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311084032 00000100:00100000:1.0:1783138254.184792:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311084032 00000100:00100000:1.0:1783138254.184853:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1783138254.184864:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:92abdb97-8e98-4553-a110-233a98850940+6:18078:x1869755311084032:12345-192.168.201.6@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783138254.184946:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:92abdb97-8e98-4553-a110-233a98850940+6:18078:x1869755311084032:12345-192.168.201.6@tcp:900:mount.lustre.0 Request processed in 85us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.184954:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1783138254.185100:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311083776 00000100:00100000:3.0:1783138254.185105:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311083776 00000100:00100000:3.0:1783138254.185132:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311083904 00000100:00100000:3.0:1783138254.185135:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311083904 00000100:00100000:3.0:1783138254.185149:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1783138254.185155:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1869755311083776:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783138254.185182:0:24279:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 92abdb97-8e98-4553-a110-233a98850940@192.168.201.6@tcp t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:3.0:1783138254.185211:0:24279:0:(genops.c:1406:class_connect()) connect: client 92abdb97-8e98-4553-a110-233a98850940, cookie 0x6bc248e9a4e98024 00002000:00100000:3.0:1783138254.185224:0:24279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 92abdb97-8e98-4553-a110-233a98850940/ffff955784145000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783138254.185235:0:24279:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783138254.185407:0:24279:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783138254.185436:0:24279:0:(import.c:65:import_set_state_nolock()) ffff955784142000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138254.185468:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92abdb97-8e98-4553-a110-233a98850940+6:2408:x1869755311083776:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 312us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138254.185476:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1783138254.185491:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1783138254.185496:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1869755311083904:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783138254.185512:0:24279:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 92abdb97-8e98-4553-a110-233a98850940@192.168.201.6@tcp t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:3.0:1783138254.185538:0:24279:0:(genops.c:1406:class_connect()) connect: client 92abdb97-8e98-4553-a110-233a98850940, cookie 0x6bc248e9a4e9802b 00002000:00100000:3.0:1783138254.185544:0:24279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 92abdb97-8e98-4553-a110-233a98850940/ffff955784144000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783138254.185572:0:24279:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783138254.185714:0:24279:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783138254.185730:0:24279:0:(import.c:65:import_set_state_nolock()) ffff955784145800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138254.185754:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92abdb97-8e98-4553-a110-233a98850940+6:2408:x1869755311083904:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 257us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138254.185761:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1783138254.197975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138254.198182:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311084160 00000100:00100000:0.0:1783138254.198193:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311084160 00000100:00100000:0.0:1783138254.198245:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1783138254.198254:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+6:18078:x1869755311084160:12345-192.168.201.6@tcp:33:mount.lustre.0 00000004:00080000:3.0:1783138254.199102:0:22774:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 764us 00000004:00200000:3.0:1783138254.241844:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783138254.242066:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+6:18078:x1869755311084160:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 43806us (44098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138254.242081:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1783138254.545286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138254.545559:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311084288 00000100:00100000:1.0:1783138254.545569:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311084288 00000100:00100000:1.0:1783138254.545678:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1783138254.545690:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+6:18124:x1869755311084288:12345-192.168.201.6@tcp:101:mkdir.0 00010000:00010000:1.0:1783138254.545713:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138254.545742:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e98032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b9692d expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.545834:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98039 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.546789:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.546812:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138254.547053:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783138254.547060:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783138254.547108:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.547142:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e98032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9692d expref: 8 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.547170:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9692d expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138254.547179:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882be8200) 00010000:00010000:1.0:1783138254.547182:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783138254.547187:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa3000, rc 0) 00000100:00100000:1.0:1783138254.547355:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+7:18124:x1869755311084288:12345-192.168.201.6@tcp:101:mkdir.0 Request processed in 1667us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138254.547364:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00010000:00010000:0.0:1783138254.901175:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138254.967954:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783138254.967980:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333216128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138254.968091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138254.968167:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333216128 00000100:00100000:2.0:1783138254.968198:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333216128 00000100:00100000:2.0:1783138254.968251:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783138254.968261:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333216128:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138254.968285:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00000024:2.0:1783138254.968292:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138254.968296:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333216256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783138254.968311:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783138254.968327:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333216384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783138254.968330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138254.968336:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333216128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138254.968345:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783138254.968362:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333216256 00000100:00100000:2.0:1783138254.968366:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333216256 00000100:00100000:3.0:1783138254.968372:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138254.968390:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783138254.968395:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b17c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333216128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138254.968398:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333216256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138254.968409:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783138254.968419:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333216384 00000100:00100000:3.0:1783138254.968424:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333216384 00000100:00100000:2.0:1783138254.968449:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333216256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138254.968456:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783138254.968460:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333216256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783138254.968478:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783138254.968488:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333216384:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783138254.968493:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1783138254.968506:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783138254.968563:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333216384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138254.968571:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138254.968784:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333216384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783138255.924936:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138255.989528:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333216512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138255.989663:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138255.989852:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333216512 00000100:00100000:0.0:1783138255.989861:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333216512 00000100:00100000:0.0:1783138255.989923:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138255.989932:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869755333216512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783138255.989957:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783138255.990018:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869755333216512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138255.990026:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138255.990093:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333216512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783138255.990332:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333216640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783138255.990364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138255.990407:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333216640 00000100:00100000:1.0:1783138255.990411:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333216640 00000100:00100000:1.0:1783138255.990435:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783138255.990441:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333216640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783138255.990452:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783138255.990482:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333216640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138255.990488:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783138255.990515:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333216640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783138255.991046:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333217024:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.991088:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138255.991107:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869755333217536:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.991130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138255.991145:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869755333218048:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.991170:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138255.991189:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783138255.991194:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333216896:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.991216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138255.991239:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333217408:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.991270:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138255.991294:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869755333217920:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.991314:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138255.991334:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333217024 00000100:00100000:0.0:1783138255.991338:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333217024 00000100:00100000:0.0:1783138255.991364:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333217408 00000100:00100000:0.0:1783138255.991366:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333217408 00000100:00100000:0.0:1783138255.991384:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138255.991390:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333217024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.991423:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333217024:12345-0@lo:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138255.991428:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138255.991439:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138255.991444:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333217408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.991467:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333217408:12345-0@lo:400:kworker.0 Request processed in 24us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138255.991472:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138255.991490:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333216896 00000100:00100000:0.0:1783138255.991493:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333216896 00000100:00100000:0.0:1783138255.991520:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783138255.991527:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333216896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138255.991551:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333217536 00000100:00100000:3.0:1783138255.991557:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333217536 00000100:00100000:0.0:1783138255.991563:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333216896:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138255.991571:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783138255.991610:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333218048 00000100:00100000:3.0:1783138255.991614:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333218048 00000100:00100000:3.0:1783138255.991648:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333217920 00000100:00100000:3.0:1783138255.991652:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333217920 00000100:00100000:3.0:1783138255.991669:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783138255.991675:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869755333217536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138255.991712:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869755333217536:12345-0@lo:400:kworker.0 Request processed in 37us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138255.991719:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783138255.991731:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783138255.991737:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869755333218048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138255.991764:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869755333218048:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138255.991770:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783138255.991781:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783138255.991787:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869755333217920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138255.991813:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869755333217920:12345-0@lo:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138255.991819:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783138255.992437:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333216896:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.992453:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333217408:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.992476:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869755333217920:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.992487:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333217024:0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.992497:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869755333217536:0@lo:400:kworker.0 00010000:00080000:0.0:1783138255.992511:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff955889f2fb80 x1869755333218048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138255.992521:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869755333218048:0@lo:400:kworker.0 00000100:00080000:2.0:1783138255.992653:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783138255.992657:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783138255.992660:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783138255.992662:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783138255.993042:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869755333217152:0@lo:400:kworker.0 00000100:00100000:1.0:1783138255.993102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138255.993135:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333217664:0@lo:400:kworker.0 00000100:00100000:1.0:1783138255.993155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138255.993184:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783138255.993191:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333216768:0@lo:400:kworker.0 00000100:00100000:1.0:1783138255.993217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138255.993252:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333217280:0@lo:400:kworker.0 00000100:00100000:3.0:1783138255.993292:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333217152 00000100:00100000:3.0:1783138255.993299:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333217152 00000100:00100000:3.0:1783138255.993337:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333217664 00000100:00100000:3.0:1783138255.993340:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333217664 00000100:00100000:3.0:1783138255.993362:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783138255.993369:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869755333217152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138255.993417:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869755333217152:12345-0@lo:400:kworker.0 Request processed in 48us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138255.993435:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783138255.993449:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783138255.993465:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333217664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138255.993493:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869755333217664:12345-0@lo:400:kworker.0 Request processed in 39us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138255.993499:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783138255.993505:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138255.993529:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869755333217792:0@lo:400:kworker.0 00000100:00100000:1.0:1783138255.993557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138255.993675:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869755333217152:0@lo:400:kworker.0 00000100:00100000:1.0:1783138255.993687:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869755333217664:0@lo:400:kworker.0 00000100:00100000:2.0:1783138255.993964:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333217792 00000100:00100000:2.0:1783138255.993969:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333217792 00000100:00100000:2.0:1783138255.994025:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783138255.994032:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869755333217792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138255.994086:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869755333217792:12345-0@lo:400:kworker.0 Request processed in 54us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138255.994099:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1783138255.994123:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783138255.994126:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783138255.994136:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333217280 00000100:00100000:2.0:1783138255.994139:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333217280 00000100:00100000:2.0:1783138255.994162:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138255.994168:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333217280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138255.994199:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333217280:12345-0@lo:400:kworker.0 Request processed in 32us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138255.994204:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783138255.994652:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333216768 00000100:00100000:0.0:1783138255.994657:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333216768 00000100:00100000:0.0:1783138255.994698:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783138255.994705:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6952850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3645:x1869755333216768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138255.994744:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6952850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3645:x1869755333216768:12345-0@lo:400:kworker.0 Request processed in 40us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138255.994750:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783138255.997325:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557838fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333216768:0@lo:400:kworker.0 00000100:00100000:1.0:1783138255.997345:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333217280:0@lo:400:kworker.0 00010000:00080000:1.0:1783138255.997375:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff955889f2c000 x1869755333217792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138255.997385:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869755333217792:0@lo:400:kworker.0 00000040:00080000:0.0:1783138256.055859:0:23528:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783138256.702069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138256.704024:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311084416 00000100:00100000:2.0:1783138256.704043:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311084416 00000100:00080000:0.0:1783138256.704370:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783138256.704396:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1783138256.704408:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+7:18177:x1869755311084416:12345-192.168.201.6@tcp:41:lfs.0 00000004:00000024:2.0:1783138256.704490:0:24301:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783138256.704593:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+7:18177:x1869755311084416:12345-192.168.201.6@tcp:41:lfs.0 Request processed in 186us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138256.704601:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1783138256.707068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138256.708294:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311084544 00000100:00100000:1.0:1783138256.708318:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311084544 00000100:00100000:1.0:1783138256.708531:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1783138256.708544:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+6:18177:x1869755311084544:12345-192.168.201.6@tcp:41:lfs.0 00000004:00000024:1.0:1783138256.708597:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138256.708942:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+6:18177:x1869755311084544:12345-192.168.201.6@tcp:41:lfs.0 Request processed in 399us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138256.708950:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00080000:0.0:1783138256.710825:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783138256.721726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138256.721897:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311084672 00000100:00100000:1.0:1783138256.721907:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311084672 00000100:00100000:1.0:1783138256.721994:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1783138256.722008:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92abdb97-8e98-4553-a110-233a98850940+6:18177:x1869755311084672:12345-192.168.201.6@tcp:13:lfs.0 00000100:00080000:0.0:1783138256.722011:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1783138256.722048:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783138256.722165:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92abdb97-8e98-4553-a110-233a98850940+6:18177:x1869755311084672:12345-192.168.201.6@tcp:13:lfs.0 Request processed in 161us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138256.722175:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1783138256.724671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138256.724867:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311084800 00000100:00100000:1.0:1783138256.724877:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311084800 00000100:00100000:1.0:1783138256.724955:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:1.0:1783138256.724967:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92abdb97-8e98-4553-a110-233a98850940+6:18177:x1869755311084800:12345-192.168.201.6@tcp:13:lfs.0 00002000:00000024:1.0:1783138256.725017:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783138256.725128:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92abdb97-8e98-4553-a110-233a98850940+6:18177:x1869755311084800:12345-192.168.201.6@tcp:13:lfs.0 Request processed in 164us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138256.725136:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00080000:0.0:1783138256.725347:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783138256.948920:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138257.010511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.010650:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311084928 00000100:00100000:2.0:1783138257.010660:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311084928 00000100:00100000:2.0:1783138257.010723:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 132 00000100:00100000:2.0:1783138257.010733:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+10:18209:x1869755311084928:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138257.010752:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138257.010773:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff955783ba1a00/0x6bc248e9a4e98040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96934 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138257.010826:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff955783ba1a00/0x6bc248e9a4e98040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96934 expref: 11 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138257.010837:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff955783ba1a00/0x6bc248e9a4e98040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96934 expref: 11 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138257.010847:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba1a00, rc 0) 00000100:00100000:2.0:1783138257.010915:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18209:x1869755311084928:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 184us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.010923:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 132 00000001:00100000:0.0:1783138257.016057:0:25096:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92abdb97-8e98-4553-a110-233a98850940 00000001:00080000:0.0:1783138257.016077:0:25096:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1783138257.023237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.023373:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311085056 00000100:00100000:1.0:1783138257.023384:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311085056 00000100:00100000:1.0:1783138257.023445:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:1.0:1783138257.023454:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18209:x1869755311085056:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783138257.023771:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18209:x1869755311085056:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 316us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.023779:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:1.0:1783138257.030050:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138257.030142:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311085184 00000100:00100000:0.0:1783138257.030153:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311085184 00000100:00100000:0.0:1783138257.030211:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:0.0:1783138257.030221:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18209:x1869755311085184:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783138257.030394:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18209:x1869755311085184:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 174us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138257.030403:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:0.0:1783138257.043488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.043664:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311085312 00000100:00100000:1.0:1783138257.043678:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311085312 00000100:00100000:1.0:1783138257.043747:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:1.0:1783138257.043759:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18216:x1869755311085312:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138257.043953:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18216:x1869755311085312:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 195us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.043962:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:3.0:1783138257.094722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.094808:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311085440 00000100:00100000:2.0:1783138257.094821:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311085440 00000100:00100000:2.0:1783138257.094895:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:2.0:1783138257.094907:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18216:x1869755311085440:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138257.095127:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18216:x1869755311085440:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 223us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.095137:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:2.0:1783138257.100842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138257.101023:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311085568 00000100:00100000:0.0:1783138257.101033:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311085568 00000100:00100000:0.0:1783138257.101097:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:0.0:1783138257.101108:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18216:x1869755311085568:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783138257.101275:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18216:x1869755311085568:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 170us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138257.101284:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:0.0:1783138257.112286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.112387:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311085696 00000100:00100000:1.0:1783138257.112398:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311085696 00000100:00100000:1.0:1783138257.112454:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:1.0:1783138257.112463:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18209:x1869755311085696:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783138257.112487:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138257.112503:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2000/0x6bc248e9a4e98047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96965 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.112549:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2000/0x6bc248e9a4e98047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96965 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.112560:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2000/0x6bc248e9a4e98047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96965 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.112569:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2000, rc 0) 00000100:00100000:1.0:1783138257.112626:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18209:x1869755311085696:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 164us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.112663:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:3.0:1783138257.115410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.115560:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311085824 00000100:00100000:2.0:1783138257.115571:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311085824 00000100:00100000:2.0:1783138257.115665:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:2.0:1783138257.115675:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18209:x1869755311085824:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783138257.115705:0:22765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783138257.115727:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783138257.115736:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783138257.115739:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783138257.115742:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783138257.115744:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1783138257.118648:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18209:x1869755311085824:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 2947us (3220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.118664:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:3.0:1783138257.121275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.121353:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311085952 00000100:00100000:2.0:1783138257.121364:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311085952 00000100:00100000:2.0:1783138257.121430:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:2.0:1783138257.121439:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18209:x1869755311085952:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138257.121475:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138257.121495:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b9696c expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138257.121528:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 13 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138257.121539:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 13 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138257.121549:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba0200, rc 0) 00000100:00100000:2.0:1783138257.122168:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18209:x1869755311085952:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 727us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.122177:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:3.0:1783138257.124453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.124592:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311086080 00000100:00100000:2.0:1783138257.124601:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311086080 00000100:00100000:2.0:1783138257.124676:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:2.0:1783138257.124686:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18209:x1869755311086080:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783138257.124831:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18209:x1869755311086080:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 146us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.124872:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:0.0:1783138257.127192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.127300:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311086208 00000100:00100000:2.0:1783138257.127309:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311086208 00000100:00100000:2.0:1783138257.127400:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:2.0:1783138257.127410:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18209:x1869755311086208:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783138257.127564:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18209:x1869755311086208:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 155us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.127573:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:3.0:1783138257.130223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.131131:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311086336 00000100:00100000:1.0:1783138257.131145:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311086336 00000100:00100000:1.0:1783138257.131196:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:1.0:1783138257.131206:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18220:x1869755311086336:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138257.131368:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18220:x1869755311086336:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 162us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.131377:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:3.0:1783138257.144299:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.144412:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311086464 00000100:00100000:1.0:1783138257.144423:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311086464 00000100:00100000:1.0:1783138257.144492:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:1.0:1783138257.144501:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18220:x1869755311086464:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138257.144679:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18220:x1869755311086464:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 178us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.144753:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:3.0:1783138257.158011:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138257.158047:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138257.158075:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138257.158098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138257.158117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138257.158142:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311087488 00000100:00100000:3.0:1783138257.158152:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311087488 00000100:00100000:3.0:1783138257.158196:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311087616 00000100:00100000:3.0:1783138257.158198:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311087616 00000100:00100000:3.0:1783138257.158214:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1783138257.158223:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92abdb97-8e98-4553-a110-233a98850940+6:2411:x1869755311087488:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138257.158317:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92abdb97-8e98-4553-a110-233a98850940+6:2411:x1869755311087488:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138257.158331:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1783138257.158346:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1783138257.158352:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92abdb97-8e98-4553-a110-233a98850940+5:2411:x1869755311087616:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138257.158373:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92abdb97-8e98-4553-a110-233a98850940+5:2411:x1869755311087616:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 22us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138257.158379:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1783138257.158401:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311086592 00000100:00100000:3.0:1783138257.158404:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311086592 00000100:00100000:3.0:1783138257.158419:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311087232 00000100:00100000:3.0:1783138257.158420:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311087232 00000100:00100000:3.0:1783138257.158432:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311087360 00000100:00100000:3.0:1783138257.158434:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311087360 00000100:00100000:3.0:1783138257.158453:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:3.0:1783138257.158459:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+7:2411:x1869755311087232:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783138257.158558:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1783138257.158569:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557842d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+6:2411:x1869755311087360:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783138257.158599:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557842d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+6:2411:x1869755311087360:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 34us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.158605:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1783138257.158618:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1783138257.158622:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1869755311086592:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783138257.158664:0:22773:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f0c4b748-a23d-4126-8d4e-17341ebd9d3a@192.168.201.6@tcp t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:2.0:1783138257.158695:0:22773:0:(genops.c:1406:class_connect()) connect: client f0c4b748-a23d-4126-8d4e-17341ebd9d3a, cookie 0x6bc248e9a4e98055 00000004:00100000:2.0:1783138257.158719:0:22773:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783138257.158796:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9558bd9c8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138257.158821:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2408:x1869755311086592:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 198us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.158828:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1783138257.158876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.158899:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311086848 00000100:00100000:2.0:1783138257.158902:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311086848 00000100:00100000:2.0:1783138257.158914:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1783138257.158918:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1869755311086848:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783138257.158932:0:22773:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from f0c4b748-a23d-4126-8d4e-17341ebd9d3a@192.168.201.6@tcp t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:2.0:1783138257.158955:0:22773:0:(genops.c:1406:class_connect()) connect: client f0c4b748-a23d-4126-8d4e-17341ebd9d3a, cookie 0x6bc248e9a4e9805c 00000004:00100000:2.0:1783138257.158967:0:22773:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783138257.159099:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9558bd9ca800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138257.159119:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2408:x1869755311086848:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 200us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.159125:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1783138257.161719:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+7:2411:x1869755311087232:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 3247us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138257.161735:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:2.0:1783138257.175001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.175059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.175162:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311086976 00000100:00100000:1.0:1783138257.175174:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311086976 00000100:00100000:1.0:1783138257.175239:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311086720 00000100:00100000:1.0:1783138257.175241:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311086720 00000100:00100000:1.0:1783138257.175261:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1783138257.175271:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:0:x1869755311086976:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783138257.175320:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138257.175398:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:0:x1869755311086976:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 128us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.175406:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1783138257.175421:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1783138257.175426:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:0:x1869755311086720:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783138257.175448:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138257.175476:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:0:x1869755311086720:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 50us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.175480:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00080000:2.0:1783138257.175906:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783138257.175910:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783138257.180059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.180162:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311087104 00000100:00100000:1.0:1783138257.180172:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311087104 00000100:00100000:1.0:1783138257.180235:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783138257.180244:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18209:x1869755311087104:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783138257.180276:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138257.180349:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18209:x1869755311087104:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 105us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.180357:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783138257.185111:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138257.185198:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311087744 00000100:00100000:3.0:1783138257.185208:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311087744 00000100:00100000:3.0:1783138257.185273:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1783138257.185284:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18209:x1869755311087744:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783138257.185377:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18209:x1869755311087744:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138257.185384:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783138257.189563:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.189710:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311088128 00000100:00100000:1.0:1783138257.189720:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311088128 00000100:00100000:1.0:1783138257.189773:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1783138257.189785:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18209:x1869755311088128:12345-192.168.201.6@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783138257.189881:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18209:x1869755311088128:12345-192.168.201.6@tcp:900:mount.lustre.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.189889:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1783138257.196323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.196364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138257.196447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138257.196545:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311087872 00000100:00100000:3.0:1783138257.196554:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311087872 00000100:00100000:3.0:1783138257.196598:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311088000 00000100:00100000:3.0:1783138257.196602:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311088000 00000100:00100000:3.0:1783138257.196668:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:3.0:1783138257.196676:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1869755311087872:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783138257.196712:0:24280:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f0c4b748-a23d-4126-8d4e-17341ebd9d3a@192.168.201.6@tcp t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:3.0:1783138257.196743:0:24280:0:(genops.c:1406:class_connect()) connect: client f0c4b748-a23d-4126-8d4e-17341ebd9d3a, cookie 0x6bc248e9a4e98063 00002000:00100000:3.0:1783138257.196754:0:24280:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f0c4b748-a23d-4126-8d4e-17341ebd9d3a/ffff955784143000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783138257.196766:0:24280:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783138257.196830:0:24280:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783138257.196869:0:24280:0:(import.c:65:import_set_state_nolock()) ffff955784140800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138257.196935:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2408:x1869755311087872:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 258us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138257.196944:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:3.0:1783138257.196962:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1783138257.196967:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1869755311088000:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783138257.196995:0:24280:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f0c4b748-a23d-4126-8d4e-17341ebd9d3a@192.168.201.6@tcp t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:3.0:1783138257.197013:0:24280:0:(genops.c:1406:class_connect()) connect: client f0c4b748-a23d-4126-8d4e-17341ebd9d3a, cookie 0x6bc248e9a4e9806a 00002000:00100000:3.0:1783138257.197018:0:24280:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f0c4b748-a23d-4126-8d4e-17341ebd9d3a/ffff955784140000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783138257.197023:0:24280:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783138257.197065:0:24280:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783138257.197084:0:24280:0:(import.c:65:import_set_state_nolock()) ffff955784141000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138257.197112:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2408:x1869755311088000:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 143us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138257.197118:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1783138257.197683:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311088256 00000100:00100000:0.0:1783138257.197691:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311088256 00000100:00100000:0.0:1783138257.197725:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1783138257.197734:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18209:x1869755311088256:12345-192.168.201.6@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783138257.197820:0:22775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783138257.197882:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18209:x1869755311088256:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 149us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138257.197891:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1783138257.416109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138257.416501:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311088384 00000100:00100000:1.0:1783138257.416511:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311088384 00000100:00100000:1.0:1783138257.416585:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1783138257.416595:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578409f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18243:x1869755311088384:12345-192.168.201.6@tcp:101:mkdir.0 00010000:00010000:1.0:1783138257.416656:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138257.416678:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b9699d expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.416741:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.416755:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.416768:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138257.416810:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783138257.416813:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783138257.416833:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.416877:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 8 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.416899:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138257.416908:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882be8200) 00010000:00010000:1.0:1783138257.416910:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783138257.416914:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2a00, rc 0) 00000100:00100000:1.0:1783138257.416986:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578409f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+7:18243:x1869755311088384:12345-192.168.201.6@tcp:101:mkdir.0 Request processed in 391us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138257.416994:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00010000:00010000:0.0:1783138257.974010:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138258.998615:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138259.075128:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333218176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783138259.075236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138259.086822:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333218176 00000100:00100000:0.0:1783138259.086841:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333218176 00000100:00100000:0.0:1783138259.086954:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783138259.086979:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333218176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138259.087024:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138259.087141:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333218176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (11904us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138259.087148:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1783138259.087405:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138259.088053:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333218176:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783138260.020909:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138260.088159:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557839fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333218304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783138260.088267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138260.088440:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578409d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333218432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138260.088478:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138260.088518:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783138260.088525:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333218560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138260.088548:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138260.088608:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333218304 00000100:00100000:1.0:1783138260.088618:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333218304 00000100:00100000:1.0:1783138260.088701:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783138260.088711:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333218304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783138260.088737:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783138260.088739:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333218432 00000100:00100000:2.0:1783138260.088748:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333218432 00000100:00100000:2.0:1783138260.088775:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333218560 00000100:00100000:2.0:1783138260.088778:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333218560 00000100:00100000:1.0:1783138260.088787:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333218304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138260.088792:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138260.088797:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333218432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783138260.088827:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783138260.088865:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333218432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138260.088873:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138260.088891:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783138260.088897:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333218560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138260.088913:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138260.088957:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333218560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138260.088963:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783138260.089015:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333218560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138260.089029:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578409d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333218432:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1783138260.089382:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138260.089494:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783138260.090172:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557839fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333218304:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1783138260.102480:0:24274:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f0c4b748-a23d-4126-8d4e-17341ebd9d3a 00000001:00100000:1.0:1783138260.102492:0:24274:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92abdb97-8e98-4553-a110-233a98850940 00000001:00100000:0.0:1783138260.108248:0:23505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f0c4b748-a23d-4126-8d4e-17341ebd9d3a 00000001:00100000:0.0:1783138260.108262:0:23505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 92abdb97-8e98-4553-a110-233a98850940 00000001:00100000:3.0:1783138260.110457:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f0c4b748-a23d-4126-8d4e-17341ebd9d3a 00000001:00100000:3.0:1783138260.110497:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 92abdb97-8e98-4553-a110-233a98850940 00000001:02000400:3.0:1783138260.630033:0:25653:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783138261.044840:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138261.109098:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578421b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333218816:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.109191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138261.109245:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578421ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333219328:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.109267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138261.109282:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578421b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869755333219840:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.109305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138261.109331:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783138261.109336:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578421bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3646:1869755333218688:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.109365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138261.109399:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333219200:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.109423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138261.109438:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869755333219712:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.109484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138261.109503:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869755333220224:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.109527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138261.109680:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578421aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333218944:0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.109715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138261.109738:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578421a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333219456:0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.109756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138261.109772:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333219968:0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.109800:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333218816 00000100:00100000:2.0:1783138261.109808:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333218816 00000100:00100000:2.0:1783138261.109856:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333219328 00000100:00100000:2.0:1783138261.109858:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333219328 00000100:00100000:2.0:1783138261.109872:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783138261.109880:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333218816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.109950:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333218816:12345-0@lo:400:kworker.0 Request processed in 70us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.109958:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783138261.109977:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783138261.109982:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333219328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.110006:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333219328:12345-0@lo:400:kworker.0 Request processed in 25us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.110012:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783138261.110030:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333219840 00000100:00100000:2.0:1783138261.110033:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333219840 00000100:00100000:2.0:1783138261.110060:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333219200 00000100:00100000:2.0:1783138261.110063:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333219200 00000100:00100000:2.0:1783138261.110071:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333219712 00000100:00100000:2.0:1783138261.110073:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333219712 00000100:00100000:2.0:1783138261.110091:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333220224 00000100:00100000:2.0:1783138261.110094:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333220224 00000100:00100000:2.0:1783138261.110110:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783138261.110116:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869755333219840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.110147:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869755333219840:12345-0@lo:400:kworker.0 Request processed in 31us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.110153:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783138261.110164:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783138261.110169:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333219200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.110194:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869755333219200:12345-0@lo:400:kworker.0 Request processed in 25us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.110210:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783138261.110222:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783138261.110227:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869755333219712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.110255:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869755333219712:12345-0@lo:400:kworker.0 Request processed in 28us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.110261:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783138261.110271:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138261.110277:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869755333220224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.110300:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869755333220224:12345-0@lo:400:kworker.0 Request processed in 24us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.110304:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138261.110321:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333218944 00000100:00100000:2.0:1783138261.110325:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333218944 00000100:00100000:2.0:1783138261.110346:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333219456 00000100:00100000:2.0:1783138261.110348:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333219456 00000100:00100000:2.0:1783138261.110367:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138261.110373:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333218944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.110405:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333218944:12345-0@lo:400:kworker.0 Request processed in 32us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.110411:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138261.110421:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138261.110427:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333219456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.110466:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333219456:12345-0@lo:400:kworker.0 Request processed in 39us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.110471:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783138261.110495:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783138261.110499:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783138261.110500:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138261.110688:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333219072:0@lo:400:kworker.0 00000100:00100000:0.0:1783138261.110722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138261.110744:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333219584:0@lo:400:kworker.0 00000100:00100000:0.0:1783138261.110764:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138261.110781:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869755333220096:0@lo:400:kworker.0 00000100:00100000:1.0:1783138261.110787:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783138261.110797:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333220352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138261.110809:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333219072 00000100:00100000:0.0:1783138261.110812:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333219072 00000100:00100000:1.0:1783138261.110840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138261.110840:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333219584 00000100:00100000:0.0:1783138261.110842:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333219584 00000100:00100000:0.0:1783138261.110857:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138261.110863:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333219072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138261.110867:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333218688 00000100:00100000:1.0:1783138261.110870:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333218688 00000100:00100000:1.0:1783138261.110896:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783138261.110896:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869755333219072:12345-0@lo:400:kworker.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138261.110914:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3646:x1869755333218688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138261.110920:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138261.110932:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783138261.110937:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333219584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138261.110943:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3646:x1869755333218688:12345-0@lo:400:kworker.0 Request processed in 42us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138261.110949:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783138261.110961:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333219584:12345-0@lo:400:kworker.0 Request processed in 24us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138261.110966:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783138261.110979:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783138261.110997:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333220352 00000100:00100000:0.0:1783138261.111001:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333220352 00000100:00100000:0.0:1783138261.111021:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783138261.111027:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333220352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783138261.111057:0:24281:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783138261.111103:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333220352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138261.111109:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783138261.114716:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1783138261.114757:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333220352:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783138261.119238:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff955784218e00 x1869755333220224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138261.119259:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869755333220224:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.119276:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578421b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333218816:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.119289:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578421ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333219328:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.119303:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578421b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869755333219840:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.119357:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578421bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3646:1869755333218688:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.119754:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869755333219200:0@lo:400:kworker.0 00000100:00100000:3.0:1783138261.119777:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869755333219712:0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.120155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138261.120209:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333220480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138261.120265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138261.120306:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578421aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333218944:0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.120319:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578421a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333219456:0@lo:400:kworker.0 00000100:00100000:0.0:1783138261.120800:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138261.120856:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869755333219072:0@lo:400:kworker.0 00000100:00100000:0.0:1783138261.120869:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333219584:0@lo:400:kworker.0 00000100:00100000:1.0:1783138261.121204:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333220480 00000100:00100000:1.0:1783138261.121213:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333220480 00000100:00100000:1.0:1783138261.121276:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138261.121285:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333220480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783138261.121314:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783138261.121590:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333220480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 305us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138261.121598:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138261.121676:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333220480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138261.121760:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333219968 00000100:00100000:2.0:1783138261.121765:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333219968 00000100:00100000:2.0:1783138261.121812:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333220096 00000100:00100000:2.0:1783138261.121816:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333220096 00000100:00100000:2.0:1783138261.121838:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138261.121845:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333219968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.121886:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869755333219968:12345-0@lo:400:kworker.0 Request processed in 42us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.121892:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138261.121917:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783138261.121924:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869755333220096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138261.121956:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869755333220096:12345-0@lo:400:kworker.0 Request processed in 34us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138261.121962:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1783138261.122142:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783138261.122146:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783138261.122168:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff955784219180 x1869755333219968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138261.122180:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869755333219968:0@lo:400:kworker.0 00000100:00100000:0.0:1783138261.122284:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869755333220096:0@lo:400:kworker.0 00000040:00080000:0.0:1783138261.434319:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783138262.069013:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138262.246080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246128:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246178:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138262.246328:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311088768 00000100:00100000:3.0:1783138262.246342:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311088768 00000100:00100000:3.0:1783138262.246411:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311089280 00000100:00100000:3.0:1783138262.246416:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311089280 00000100:00100000:3.0:1783138262.246430:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311088640 00000100:00100000:3.0:1783138262.246433:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311088640 00000100:00100000:3.0:1783138262.246447:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311089152 00000100:00100000:3.0:1783138262.246450:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311089152 00000100:00100000:3.0:1783138262.246467:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:3.0:1783138262.246477:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+5:2410:x1869755311088768:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138262.246555:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+5:2410:x1869755311088768:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 79us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138262.246563:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:3.0:1783138262.246578:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1783138262.246598:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2410:x1869755311089280:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138262.246624:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2410:x1869755311089280:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138262.246653:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1783138262.246666:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:3.0:1783138262.246673:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+6:2410:x1869755311088640:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138262.246697:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+6:2410:x1869755311088640:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138262.246703:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:3.0:1783138262.246714:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:3.0:1783138262.246720:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2410:x1869755311089152:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138262.246741:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2410:x1869755311089152:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 22us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138262.246746:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:3.0:1783138262.246764:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311089024 00000100:00100000:3.0:1783138262.246767:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311089024 00000100:00100000:3.0:1783138262.246792:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311089536 00000100:00100000:3.0:1783138262.246795:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311089536 00000100:00100000:3.0:1783138262.246806:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311088896 00000100:00100000:3.0:1783138262.246808:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311088896 00000100:00100000:3.0:1783138262.246817:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311089408 00000100:00100000:3.0:1783138262.246819:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311089408 00000100:00100000:3.0:1783138262.246830:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1783138262.246835:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92abdb97-8e98-4553-a110-233a98850940+5:2410:x1869755311089024:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138262.246860:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92abdb97-8e98-4553-a110-233a98850940+5:2410:x1869755311089024:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138262.246877:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1783138262.246911:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783138262.246918:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2410:x1869755311089536:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138262.246944:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2410:x1869755311089536:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138262.246949:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783138262.246960:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1783138262.246964:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92abdb97-8e98-4553-a110-233a98850940+5:2410:x1869755311088896:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138262.246982:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92abdb97-8e98-4553-a110-233a98850940+5:2410:x1869755311088896:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 18us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138262.246987:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1783138262.246995:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1783138262.247000:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2410:x1869755311089408:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138262.247018:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2410:x1869755311089408:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 18us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138262.247023:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1783138262.248324:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311088512 00000100:00100000:1.0:1783138262.248338:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311088512 00000100:00100000:1.0:1783138262.248422:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 146 00000100:00100000:1.0:1783138262.248431:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+13:2410:x1869755311088512:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783138262.248489:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+13:2410:x1869755311088512:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 58us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138262.248496:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 146 00000100:00080000:1.0:1783138262.248537:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783138262.248543:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783138262.248547:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783138262.248549:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783138263.093764:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783138263.167789:0:25096:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f0c4b748-a23d-4126-8d4e-17341ebd9d3a 00010000:00010000:2.0:1783138264.120993:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138264.180954:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783138264.180976:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333220608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783138264.181049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138264.181205:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333220608 00000100:00100000:2.0:1783138264.181214:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333220608 00000100:00100000:2.0:1783138264.181291:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138264.181301:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333220608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783138264.181329:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783138264.181377:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333220608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138264.181385:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138264.181434:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333220608:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783138264.181540:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1783138264.428877:0:25800:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3b34dd40 20000000:00000080:0.0:1783138264.428898:0:25800:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff955898166c00 uarg=0000000000000000 20000000:01000000:0.0:1783138264.429072:0:25800:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783138264.429078:0:25800:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783138264.429088:0:25800:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783138264.429881:0:25801:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1783138264.430127:0:25800:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783138264.440112:0:25800:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783138264.440146:0:25800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440166:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440174:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440181:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440187:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440196:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440203:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440210:0:25800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440252:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440265:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 12 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138264.440294:0:25800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557839fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333220736:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783138264.440417:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440425:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 12 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138264.440433:0:25800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557839fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333220864:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783138264.440463:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440471:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 23 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138264.440480:0:25800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557839fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333220992:0@lo:104: 00000100:00100000:0.0:1783138264.440519:0:25800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783138264.440562:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440570:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 23 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138264.440578:0:25800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557839fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333221120:0@lo:104: 00000100:00100000:0.0:1783138264.440599:0:25800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783138264.440662:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440670:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 23 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138264.440687:0:25800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9557839fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333221248:0@lo:104: 00000100:00100000:0.0:1783138264.440712:0:25800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783138264.440735:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.440743:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 23 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138264.440951:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333220992 00000100:00100000:2.0:1783138264.440959:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333220992 00000100:00100000:2.0:1783138264.441006:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333221120 00000100:00100000:2.0:1783138264.441010:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333221120 00000100:00100000:2.0:1783138264.441020:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333221248 00000100:00100000:2.0:1783138264.441021:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333221248 00000100:00100000:2.0:1783138264.441034:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138264.441041:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+5:25800:x1869755333220992:12345-0@lo:104: 00010000:00010000:2.0:1783138264.441053:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441100:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783138264.441106:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+5:25800:x1869755333220992:12345-0@lo:104: Request processed in 65us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138264.441113:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138264.441131:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138264.441136:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+4:25800:x1869755333221120:12345-0@lo:104: 00010000:00010000:2.0:1783138264.441144:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441192:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783138264.441198:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+4:25800:x1869755333221120:12345-0@lo:104: Request processed in 62us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138264.441204:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138264.441222:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138264.441228:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557839fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:25800:x1869755333221248:12345-0@lo:104: 00010000:00010000:2.0:1783138264.441235:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441258:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783138264.441262:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557839fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:25800:x1869755333221248:12345-0@lo:104: Request processed in 35us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138264.441267:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1783138264.441287:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783138264.441292:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441299:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a5596400 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138264.441303:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441311:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138264.441318:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138264.441324:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138264.441380:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441387:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138264.441413:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441420:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558a5596400/0x6bc248e9a4e97ea3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97eaa expref: -99 pid: 25095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441434:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138264.441437:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441442:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa3200 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138264.441445:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441452:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138264.441458:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138264.441463:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138264.441476:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441481:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138264.441487:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441503:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b6fa3200/0x6bc248e9a4e97d22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97d29 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441513:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138264.441516:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441520:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302ae00 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138264.441523:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441529:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138264.441535:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138264.441540:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138264.441553:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441558:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138264.441574:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441580:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff95588302ae00/0x6bc248e9a4e97ce3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cea expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.441588:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138264.441595:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138264.441596:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138264.441603:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138264.441625:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333221504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138264.441680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138264.441707:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138264.441713:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578430b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333221632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138264.441734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138264.441970:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578430aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333221760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138264.441995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138264.442029:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333221504 00000100:00100000:2.0:1783138264.442033:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333221504 00010000:00010000:2.0:1783138264.442057:0:24306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 24 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138264.442077:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333221632 00000100:00100000:2.0:1783138264.442080:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333221632 00010000:00010000:2.0:1783138264.442090:0:24306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 25 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138264.442100:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333221760 00000100:00100000:2.0:1783138264.442103:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333221760 00010000:00010000:2.0:1783138264.442111:0:24306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 26 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138264.442123:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138264.442129:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+26:3645:x1869755333221504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138264.442139:0:24306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138264.442144:0:24306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 26 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138264.442213:0:25800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333221376:0@lo:104: 00000100:00100000:0.0:1783138264.442239:0:25800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138264.442266:0:25800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1783138264.442287:0:25800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557839fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333220992:0@lo:104: 00000100:00100000:0.0:1783138264.442295:0:25800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557839fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333221120:0@lo:104: 00000100:00100000:0.0:1783138264.442302:0:25800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557839fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333221248:0@lo:104: 00000100:00100000:3.0:1783138264.443124:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138264.443135:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+26:3645:x1869755333221632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783138264.443147:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138264.443153:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 26 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138264.443447:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333221376 00000100:00100000:0.0:1783138264.443455:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333221376 00000100:00100000:0.0:1783138264.443484:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138264.443490:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:25800:x1869755333221376:12345-0@lo:104: 00010000:00010000:0.0:1783138264.443501:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138264.443557:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783138264.443562:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+3:25800:x1869755333221376:12345-0@lo:104: Request processed in 72us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138264.443570:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138264.443608:0:25800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333221376:0@lo:104: 00000100:00100000:0.0:1783138264.444728:0:22757:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783138264.444754:0:22757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1783138264.447327:0:24306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 26 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.447362:0:24306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95588302a000/0x6bc248e9a4e97eaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97ea3 expref: 26 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.447379:0:24306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138264.447470:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+25:3645:x1869755333221504:12345-0@lo:103:ldlm_bl.0 Request processed in 5339us (5787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138264.447481:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138264.447513:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138264.447524:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3647:x1869755333221760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138264.447539:0:24306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138264.447545:0:24306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 24 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.447553:0:24306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 24 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.447563:0:24306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b7024800/0x6bc248e9a4e97cea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97ce3 expref: 24 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.447571:0:24306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138264.447599:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:3647:x1869755333221760:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (5603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138264.447605:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138264.447669:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578430aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3647:1869755333221760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138264.447716:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138264.447722:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.447729:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7025000 already unused, calling callback (ffffffffc128bc20) 10000000:00010000:2.0:1783138264.447733:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.447743:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138264.447869:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333221504:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1783138264.448039:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138264.448047:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138264.448090:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.448097:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138264.448116:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.448122:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9558b7025000/0x6bc248e9a4e97cd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6bc248e9a4e97cdc expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.448136:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138264.448137:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138264.448139:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138264.448152:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578430aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333221888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138264.448190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138264.448242:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333221888 00000100:00100000:2.0:1783138264.448248:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333221888 00010000:00010000:2.0:1783138264.448269:0:24306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 23 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138264.448286:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783138264.448292:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:3648:x1869755333221888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138264.448302:0:24306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138264.448306:0:24306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 23 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.448313:0:24306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 23 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.448323:0:24306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558b6fa2e00/0x6bc248e9a4e97cdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97cd5 expref: 23 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.448334:0:24306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138264.448360:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:3648:x1869755333221888:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138264.448367:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783138264.448392:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578430aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333221888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783138264.449184:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 21 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.449205:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95588302b000/0x6bc248e9a4e97d29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6bc248e9a4e97d22 expref: 21 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.449215:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138264.449254:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:3645:x1869755333221632:12345-0@lo:103:ldlm_bl.0 Request processed in 6121us (7518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138264.449261:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138264.449293:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578430b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3645:1869755333221632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138264.449496:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138264.449564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138264.450026:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311089664 00000100:00100000:3.0:1783138264.450033:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311089664 00010000:00010000:3.0:1783138264.450061:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 13 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138264.450078:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311089792 00000100:00100000:3.0:1783138264.450081:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311089792 00010000:00010000:3.0:1783138264.450092:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 14 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138264.450106:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1783138264.450113:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955882b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9768c8db-2837-4b37-8344-aa5fc6411a75+14:2409:x1869755311089664:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138264.450126:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138264.450130:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 14 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.450141:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 14 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.450151:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138264.450193:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955882b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9768c8db-2837-4b37-8344-aa5fc6411a75+14:2409:x1869755311089664:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 80us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138264.450200:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1783138264.450238:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1783138264.450244:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9768c8db-2837-4b37-8344-aa5fc6411a75+13:2409:x1869755311089792:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138264.450252:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138264.450256:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 13 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.450265:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 13 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.450277:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.450286:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.450302:0:22759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.451556:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.451570:0:22759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.451577:0:22759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.451584:0:22759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a5597400 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:3.0:1783138264.451601:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.451610:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.451622:0:22759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138264.451732:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138264.451785:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9768c8db-2837-4b37-8344-aa5fc6411a75+13:2409:x1869755311089792:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 1538us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138264.451795:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00010000:00010000:2.0:1783138264.453070:0:25800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e9804e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9696c expref: 12 pid: 22766 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138264.453090:0:25800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557839fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333220736:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783138264.453105:0:25800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95588302b200/0x6bc248e9a4e9800f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b968fc expref: 11 pid: 22764 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138264.453136:0:25800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9557839fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1869755333220864:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783138264.453172:0:25800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.453181:0:25800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.453186:0:25800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138264.453192:0:25800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9558a5597400/0x6bc248e9a4e9807f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.141648:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138265.204908:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783138265.204937:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578430aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333222016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783138265.205370:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783138265.205372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138265.205382:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333222272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783138265.205417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138265.205418:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333222144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138265.205442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138265.205472:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333222016 00000100:00100000:1.0:1783138265.205480:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333222016 00000100:00100000:2.0:1783138265.205490:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333222144 00000100:00100000:2.0:1783138265.205493:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333222144 00000100:00100000:1.0:1783138265.205540:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783138265.205550:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333222016:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138265.205550:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333222272 00000100:00100000:0.0:1783138265.205555:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333222272 00000100:00100000:0.0:1783138265.205599:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138265.205606:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333222272:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:1.0:1783138265.205613:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00002000:00000024:0.0:1783138265.205621:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783138265.205683:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333222016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138265.205683:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333222272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138265.205692:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783138265.205692:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783138265.205708:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1783138265.205712:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138265.205714:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333222144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783138265.205734:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138265.205758:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333222144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138265.205759:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578430aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333222016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138265.205763:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783138265.205771:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333222144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138265.210953:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333222272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138265.810612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138265.810889:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311089920 00000100:00100000:3.0:1783138265.810900:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311089920 00000100:00100000:3.0:1783138265.810981:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1783138265.810993:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+6:18712:x1869755311089920:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783138265.811016:0:24301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1783138265.811035:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783138265.811043:0:24301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e98086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969a4 expref: -99 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811109:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811124:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811165:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811181:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811188:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811194:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811274:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042000/0x6bc248e9a4e9809b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811281:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042000/0x6bc248e9a4e9809b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811459:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042000/0x6bc248e9a4e9809b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138265.811493:0:24301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783138265.811497:0:24301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138265.811530:0:24301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042000/0x6bc248e9a4e9809b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811541:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811548:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811565:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811585:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2043c00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138265.811589:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811598:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811611:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882be8200) 00010000:00010000:3.0:1783138265.811614:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138265.811618:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811664:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e9808d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811681:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811688:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811693:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811698:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2042c00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138265.811700:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811715:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811723:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9557828b5800) 00010000:00010000:3.0:1783138265.811726:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138265.811728:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811734:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e98094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811770:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e98086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969a4 expref: 8 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811785:0:24301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042000/0x6bc248e9a4e9809b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969a4 expref: 7 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.811792:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9557828b5b00) 00010000:00010000:3.0:1783138265.811794:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783138265.811797:0:24301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558c2042000, rc 0) 00000100:00100000:3.0:1783138265.811911:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+7:18712:x1869755311089920:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 920us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138265.811919:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:2.0:1783138265.814378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138265.814529:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311090048 00000100:00100000:0.0:1783138265.814539:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311090048 00000100:00100000:0.0:1783138265.814603:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1783138265.814613:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:92abdb97-8e98-4553-a110-233a98850940+7:18712:x1869755311090048:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783138265.814775:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:92abdb97-8e98-4553-a110-233a98850940+7:18712:x1869755311090048:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 Request processed in 163us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138265.814784:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1783138265.816773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138265.816863:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311090304 00000100:00100000:1.0:1783138265.816873:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311090304 00000100:00100000:1.0:1783138265.816951:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1783138265.816962:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+7:18712:x1869755311090304:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783138265.816982:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138265.817003:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e980a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969ab expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817081:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817095:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817106:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817141:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817148:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817155:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817261:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2e00/0x6bc248e9a4e980b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817270:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2e00/0x6bc248e9a4e980b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817276:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2e00/0x6bc248e9a4e980b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138265.817285:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783138265.817439:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817446:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817452:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817459:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa3800 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138265.817469:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817488:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817501:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9557828b5b00) 00010000:00010000:1.0:1783138265.817505:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138265.817510:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817516:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e980a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817528:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817534:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817540:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817544:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa3200 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138265.817547:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817552:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817559:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff955882be8c00) 00010000:00010000:1.0:1783138265.817561:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138265.817564:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.817591:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e980b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.818696:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2400/0x6bc248e9a4e980a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ab expref: 10 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.818722:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2e00/0x6bc248e9a4e980b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ab expref: 9 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.818730:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff955882be8e00) 00010000:00010000:1.0:1783138265.818733:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138265.818736:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2e00, rc 0) 00000100:00100000:1.0:1783138265.818830:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+9:18712:x1869755311090304:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1859us (2057us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1783138265.818842:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1783138265.821895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138265.822173:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311090432 00000100:00100000:3.0:1783138265.822183:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311090432 00000100:00100000:3.0:1783138265.822251:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1783138265.822262:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+9:18712:x1869755311090432:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783138265.822721:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+9:18712:x1869755311090432:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 459us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138265.822729:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:2.0:1783138265.826895:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138265.827038:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311090560 00000100:00100000:1.0:1783138265.827049:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311090560 00000100:00100000:1.0:1783138265.827135:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00080000:0.0:1783138265.827219:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783138265.827241:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+5:18712:x1869755311090560:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1783138265.828492:0:22771:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1190us 00000100:00100000:3.0:1783138265.849143:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+5:18712:x1869755311090560:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 21982us (22244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138265.849170:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:0.0:1783138265.886272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138265.886433:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311090688 00000100:00100000:3.0:1783138265.886445:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311090688 00000100:00100000:3.0:1783138265.886510:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:3.0:1783138265.886521:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+9:18718:x1869755311090688:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783138265.886544:0:24301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138265.886564:0:24301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969b2 expref: -99 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886673:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886689:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886700:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886756:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886764:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886789:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886840:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886847:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886854:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886860:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2042c00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138265.886874:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886882:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886895:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882be8200) 00010000:00010000:3.0:1783138265.886898:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138265.886902:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886909:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e980cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886923:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886929:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886941:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886946:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2043c00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138265.886949:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886955:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886963:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9557828b5800) 00010000:00010000:3.0:1783138265.886966:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138265.886968:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.886974:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043c00/0x6bc248e9a4e980d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.887008:0:24301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969b2 expref: 10 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.887019:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882be8200) 00010000:00010000:3.0:1783138265.887021:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138265.887025:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969b2 expref: 10 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.887035:0:24301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558c2042a00, rc 0) 00000100:00100000:3.0:1783138265.887105:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+9:18718:x1869755311090688:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 584us (844us total) trans 0 rc 301/301 00000100:00100000:3.0:1783138265.887121:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1783138265.894976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138265.895174:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311090816 00000100:00100000:1.0:1783138265.895186:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311090816 00000100:00100000:1.0:1783138265.895240:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783138265.895250:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:92abdb97-8e98-4553-a110-233a98850940+9:18718:x1869755311090816:12345-192.168.201.6@tcp:700:lfs.0 00000100:00100000:1.0:1783138265.895341:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:92abdb97-8e98-4553-a110-233a98850940+9:18718:x1869755311090816:12345-192.168.201.6@tcp:700:lfs.0 Request processed in 92us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138265.895365:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1783138265.902761:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138265.902860:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311091072 00000100:00100000:3.0:1783138265.902884:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311091072 00000100:00100000:3.0:1783138265.902953:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:3.0:1783138265.902964:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+9:18718:x1869755311091072:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:3.0:1783138265.903033:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138265.903065:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98039 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9692d expref: 9 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.903090:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882be8200) 00010000:00010000:3.0:1783138265.903097:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783138265.903348:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.903363:0:22773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 5 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.903373:0:22773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.903410:0:22773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 5 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.903425:0:22773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 5 pid: 22771 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138265.903440:0:22773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bcb09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22773:1869755333222400:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783138265.903547:0:22773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1f8a000 going to sleep for 11 seconds 10000000:01000000:1.0:1783138265.909029:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783138265.909037:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff955782aed800 from 13 10000000:01000000:1.0:1783138265.909042:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783138265.909094:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e980e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.909107:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e980e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.909119:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e980e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138265.909155:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333222528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138265.909232:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138265.909281:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff955782a50900 going to sleep for 11 seconds 00000100:00100000:2.0:1783138265.909395:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333222528 00000100:00100000:2.0:1783138265.909403:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333222528 00000100:00100000:2.0:1783138265.909460:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783138265.909470:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589ddfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+20:22768:x1869755333222528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138265.909484:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138265.909498:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e980e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e980e1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.909536:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e980e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e980e1 expref: 21 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.909548:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff955783ba0200/0x6bc248e9a4e980e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e980e1 expref: 21 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.909556:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba0200, rc 0) 00000100:00100000:2.0:1783138265.909605:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589ddfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333222528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138265.909613:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783138265.909754:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333222528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138265.909768:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e980e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e980e8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.909777:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e980e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e980e8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138265.909965:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bcb0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333222656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138265.909998:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138265.910030:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1f8aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138265.910088:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333222656 00000100:00100000:2.0:1783138265.910092:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333222656 00000100:00100000:2.0:1783138265.910125:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783138265.910133:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333222656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138265.910264:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333222656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138265.910272:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783138265.910347:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bcb0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333222656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.910389:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333222784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.910429:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138265.910454:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1783138265.910554:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333222784 00000100:00100000:2.0:1783138265.910558:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333222784 00000100:00100000:2.0:1783138265.910578:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783138265.910584:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333222784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138265.910688:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333222784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138265.910695:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783138265.910774:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333222784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783138265.911723:0:25815:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783138265.912032:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783138265.912056:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783138265.912077:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e980e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e980e8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.912087:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558b6fa2400/0x6bc248e9a4e980e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e980e8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138265.912099:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783138265.912101:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9558a576a800 from 13 10000000:01000000:2.0:1783138265.912103:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138265.912135:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff955783ba0400/0x6bc248e9a4e980ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.912154:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff955783ba0400/0x6bc248e9a4e980ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.912163:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff955783ba0400/0x6bc248e9a4e980ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138265.912181:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578430b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333222912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138265.912227:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138265.912264:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a54f1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138265.912348:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333222912 00000100:00100000:0.0:1783138265.912354:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333222912 00000100:00100000:0.0:1783138265.912380:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783138265.912387:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+21:22768:x1869755333222912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138265.912397:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138265.912409:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558a5596c00/0x6bc248e9a4e980f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e980ef expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138265.912431:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558a5596c00/0x6bc248e9a4e980f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e980ef expref: 22 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138265.912441:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558a5596c00/0x6bc248e9a4e980f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e980ef expref: 22 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138265.912449:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558a5596c00, rc 0) 00000100:00100000:0.0:1783138265.912492:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:22768:x1869755333222912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138265.912498:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783138265.912568:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578430b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333222912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138265.912582:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff955783ba0400/0x6bc248e9a4e980ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e980f6 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.912590:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff955783ba0400/0x6bc248e9a4e980ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e980f6 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138265.912665:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578430b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138265.912698:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138265.912713:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a54f1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138265.912789:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333223040 00000100:00100000:0.0:1783138265.912793:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333223040 00000100:00100000:0.0:1783138265.912812:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783138265.912828:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:22768:x1869755333223040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.912942:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:22768:x1869755333223040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138265.912949:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783138265.912980:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578430b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.913006:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.913043:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138265.913064:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138265.913074:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333223168 00000100:00100000:0.0:1783138265.913077:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333223168 00000100:00100000:0.0:1783138265.913094:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783138265.913099:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955783a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:22768:x1869755333223168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.913184:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955783a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:22768:x1869755333223168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138265.913191:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783138265.913228:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783138265.914486:0:25816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783138265.916515:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783138265.916569:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783138265.916582:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff955783ba0400/0x6bc248e9a4e980ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e980f6 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.916596:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff955783ba0400/0x6bc248e9a4e980ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e980f6 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138265.916610:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783138265.916613:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9557828c9000 from 13 10000000:01000000:2.0:1783138265.916616:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138265.920435:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff955783ba1e00/0x6bc248e9a4e980fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.920463:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff955783ba1e00/0x6bc248e9a4e980fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.920476:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff955783ba1e00/0x6bc248e9a4e980fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138265.920508:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578430b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138265.920580:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138265.920625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138265.920701:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333223296 00000100:00100000:1.0:1783138265.920710:0:22773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bcb09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22773:1869755333222400:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783138265.920711:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333223296 00010000:00010000:1.0:1783138265.920745:0:22773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138265.920775:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783138265.920785:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+22:22768:x1869755333223296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138265.920799:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138265.920813:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558c2043c00/0x6bc248e9a4e98104 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e980fd expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138265.920859:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a54f1b40 going to sleep for 11 seconds 00010000:00010000:3.0:1783138265.920863:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558c2043c00/0x6bc248e9a4e98104 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e980fd expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.920875:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558c2043c00/0x6bc248e9a4e98104 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e980fd expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.920884:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558c2043c00, rc 0) 00000100:00100000:3.0:1783138265.920919:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333223296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138265.920938:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783138265.920946:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578430b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138265.920961:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff955783ba1e00/0x6bc248e9a4e980fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e98104 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138265.920982:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff955783ba1e00/0x6bc248e9a4e980fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e98104 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138265.921000:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311091200 00000100:00100000:3.0:1783138265.921005:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311091200 00000100:00100000:2.0:1783138265.921042:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95578430b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223424:0@lo:501:ll_cfg_requeue.0 00010000:00010000:3.0:1783138265.921050:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 6 pid: 22771 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138265.921072:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138265.921081:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783138265.921092:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:2410:x1869755311091200:12345-192.168.201.6@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783138265.921098:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558a54f1b40 going to sleep for 11 seconds 00010000:00010000:3.0:1783138265.921103:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138265.921111:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 6 pid: 22771 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138265.921122:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333223424 00010000:00010000:3.0:1783138265.921126:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 6 pid: 22771 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138265.921127:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333223424 00010000:00010000:3.0:1783138265.921152:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b9699d expref: 6 pid: 22771 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.921168:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882be8200) 00010000:00010000:3.0:1783138265.921172:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.921182:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.921189:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.921216:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1783138265.921234:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783138265.921248:0:22773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138265.921258:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2410:x1869755311091200:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 166us (634us total) trans 0 rc 0/0 00010000:00010000:1.0:1783138265.921259:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138265.921273:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:1.0:1783138265.921289:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.921311:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.921320:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138265.921939:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783138265.921952:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333223424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138265.922059:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333223424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138265.922066:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783138265.923199:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95578430b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138265.923257:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bcb0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783138265.923596:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138265.923665:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1f8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138265.923681:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333223552 00000100:00100000:1.0:1783138265.923688:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333223552 00000100:00100000:1.0:1783138265.923727:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783138265.923736:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558935eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333223552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138265.924013:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558935eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333223552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138265.924023:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783138265.924024:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bcb0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783138265.925772:0:25817:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783138265.926050:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783138265.926076:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783138265.926089:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff955783ba1e00/0x6bc248e9a4e980fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e98104 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138265.926100:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff955783ba1e00/0x6bc248e9a4e980fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e98104 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138265.926111:0:22768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783138265.926122:0:22768:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9558b1cfd000 from 13 10000000:01000000:0.0:1783138265.926124:0:22768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783138265.926265:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558a5597c00/0x6bc248e9a4e98112 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138265.926275:0:22768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9558a5597c00/0x6bc248e9a4e98112 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138265.926287:0:22768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9558a5597c00/0x6bc248e9a4e98112 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138265.926311:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138265.926395:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926409:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926421:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783138265.926438:0:22773:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b4fbd42 reply state 000000004a1e516b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926451:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926459:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00000100:00100000:0.0:1783138265.926596:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138265.926671:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1783138265.926747:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333223680 00000100:00100000:3.0:1783138265.926754:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333223680 00000100:00100000:3.0:1783138265.926807:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783138265.926828:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+23:22768:x1869755333223680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138265.926887:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783138265.926891:0:22773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783138265.926899:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783138265.926908:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926915:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926921:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926940:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2042a00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138265.926944:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926951:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926963:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882be8200) 00010000:00010000:1.0:1783138265.926965:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138265.926969:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.926974:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e980da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783138265.926993:0:22773:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b4fbd42 reply state 000000004a1e516b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.927002:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138265.927018:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff955882be8800) 00010000:00010000:1.0:1783138265.927020:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783138265.927022:0:22773:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783138265.927124:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+10:18718:x1869755311091072:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 24161us (24374us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1783138265.927132:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00010000:00010000:3.0:1783138265.928127:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138265.928218:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558c2043000/0x6bc248e9a4e98120 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6bc248e9a4e98112 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.928247:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558c2043000/0x6bc248e9a4e98120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6bc248e9a4e98112 expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.928258:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558c2043000/0x6bc248e9a4e98120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6bc248e9a4e98112 expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138265.928267:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558c2043000, rc 0) 00000100:00100000:3.0:1783138265.928482:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:22768:x1869755333223680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1665us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138265.928499:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783138265.928595:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138265.928617:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9558a5597c00/0x6bc248e9a4e98112 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e98120 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138265.928689:0:22768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9558a5597c00/0x6bc248e9a4e98112 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6bc248e9a4e98120 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138265.928770:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.928805:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138265.928843:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138265.928897:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333223808 00000100:00100000:2.0:1783138265.928903:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333223808 00000100:00100000:2.0:1783138265.928944:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783138265.928953:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:22768:x1869755333223808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138265.929069:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:22768:x1869755333223808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138265.929076:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783138265.929241:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.929269:0:22768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138265.929474:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138265.929495:0:22768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138265.929541:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333223936 00000100:00100000:3.0:1783138265.929546:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333223936 00000100:00100000:3.0:1783138265.929580:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783138265.929586:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:22768:x1869755333223936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783138265.929699:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:22768:x1869755333223936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138265.929706:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783138265.932434:0:22768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:22768:1869755333223936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783138265.933362:0:25818:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783138265.933813:0:22768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783138265.933849:0:22768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783138265.933860:0:22768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9558a5597c00/0x6bc248e9a4e98112 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e98120 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138265.933874:0:22768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9558a5597c00/0x6bc248e9a4e98112 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6bc248e9a4e98120 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138266.080192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.080294:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311091328 00000100:00100000:2.0:1783138266.080306:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311091328 00000100:00100000:2.0:1783138266.080376:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1783138266.080386:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+10:18726:x1869755311091328:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:2.0:1783138266.080412:0:24301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138266.080453:0:24301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e98127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969b9 expref: -99 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.080519:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1200/0x6bc248e9a4e9812e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.080533:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1200/0x6bc248e9a4e9812e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.080547:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1200/0x6bc248e9a4e9812e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138266.080597:0:24301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783138266.080601:0:24301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783138266.080678:0:24301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1200/0x6bc248e9a4e9812e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.080703:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e98127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969b9 expref: 12 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.080720:0:24301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1200/0x6bc248e9a4e9812e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969b9 expref: 11 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.080729:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882f5b900) 00010000:00010000:2.0:1783138266.080732:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783138266.080735:0:24301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba1200, rc 0) 00000100:00100000:2.0:1783138266.080798:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+11:18726:x1869755311091328:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 412us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.080805:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1783138266.100725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138266.100909:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311091456 00000100:00100000:0.0:1783138266.100920:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311091456 00000100:00100000:0.0:1783138266.100984:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:0.0:1783138266.100996:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:18727:x1869755311091456:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783138266.101018:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138266.101042:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596000/0x6bc248e9a4e98135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969c0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.101114:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597000/0x6bc248e9a4e9813c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.101129:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597000/0x6bc248e9a4e9813c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.101142:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597000/0x6bc248e9a4e9813c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138266.101314:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783138266.101318:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783138266.101340:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597000/0x6bc248e9a4e9813c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.101375:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596000/0x6bc248e9a4e98135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969c0 expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.101393:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597000/0x6bc248e9a4e9813c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969c0 expref: 6 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.101402:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882f5b900) 00010000:00010000:0.0:1783138266.101405:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783138266.101409:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558a5597000, rc 0) 00000100:00100000:0.0:1783138266.101521:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18727:x1869755311091456:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 526us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.101530:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1783138266.110724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.110842:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311091584 00000100:00100000:2.0:1783138266.110853:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311091584 00000100:00100000:2.0:1783138266.110921:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:2.0:1783138266.110932:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+6:18727:x1869755311091584:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783138266.110953:0:24301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138266.110975:0:24301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e98143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969c7 expref: -99 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111038:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111052:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111063:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111073:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111082:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111089:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111185:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e98158 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111193:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e98158 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111222:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e98158 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138266.111266:0:24301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783138266.111270:0:24301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783138266.111297:0:24301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e98158 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111309:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111315:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111321:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111326:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0000 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:2.0:1783138266.111330:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111337:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111349:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882f5b900) 00010000:00010000:2.0:1783138266.111351:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138266.111363:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111370:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9814a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111392:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111398:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111404:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111410:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba1400 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:2.0:1783138266.111412:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111418:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111427:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff955882be8800) 00010000:00010000:2.0:1783138266.111429:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138266.111432:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111437:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111462:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e98143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969c7 expref: 8 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111474:0:24301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e98158 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969c7 expref: 7 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.111490:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:2.0:1783138266.111493:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783138266.111495:0:24301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba1c00, rc 0) 00000100:00100000:2.0:1783138266.111556:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+7:18727:x1869755311091584:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 625us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.111563:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:3.0:1783138266.115832:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138266.116028:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311091712 00000100:00100000:0.0:1783138266.116039:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311091712 00000100:00100000:0.0:1783138266.116122:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1783138266.116133:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:18727:x1869755311091712:12345-192.168.201.6@tcp:900:lfs.0 00000100:00100000:0.0:1783138266.116230:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:18727:x1869755311091712:12345-192.168.201.6@tcp:900:lfs.0 Request processed in 98us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.116238:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00080000:1.0:1783138266.116490:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783138266.118993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.119080:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311091968 00000100:00100000:1.0:1783138266.119090:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311091968 00000100:00100000:1.0:1783138266.119158:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:1.0:1783138266.119169:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+7:18727:x1869755311091968:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783138266.119188:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138266.119211:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e9815f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969ce expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138266.119321:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783138266.119427:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e9815f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ce expref: 9 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.119440:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882f5b900) 00010000:00010000:1.0:1783138266.119443:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783138266.119447:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e9815f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ce expref: 9 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.119460:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2a00, rc 0) 00000100:00100000:1.0:1783138266.119519:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+8:18727:x1869755311091968:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 351us (533us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1783138266.119539:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1783138266.122740:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.122881:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311092224 00000100:00100000:2.0:1783138266.122892:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311092224 00000100:00100000:2.0:1783138266.122960:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:2.0:1783138266.122972:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+8:18727:x1869755311092224:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:2.0:1783138266.123034:0:24301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138266.123061:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e98158 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969c7 expref: 8 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.123078:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:2.0:1783138266.123082:0:24301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783138266.123104:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.123118:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.123127:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783138266.123554:0:24301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045cfca74 reply state 00000000feb4fd0b transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.123588:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.123595:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:2.0:1783138266.123598:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1783138266.123600:0:24301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783138266.123610:0:24301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783138266.123736:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+9:18727:x1869755311092224:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 766us (1007us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1783138266.123745:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1783138266.126855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138266.127057:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311092480 00000100:00100000:0.0:1783138266.127066:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311092480 00000100:00100000:0.0:1783138266.127122:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:0.0:1783138266.127132:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+9:18727:x1869755311092480:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1783138266.127390:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+10:18727:x1869755311092480:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 258us (555us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1783138266.127413:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:0.0:1783138266.136189:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.136250:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311092736 00000100:00100000:2.0:1783138266.136261:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311092736 00000100:00100000:2.0:1783138266.136488:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:2.0:1783138266.136500:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+10:18727:x1869755311092736:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783138266.136526:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138266.136547:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969d5 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.136617:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.136650:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.136662:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.136674:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.136700:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.136708:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138266.136811:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783138266.137036:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137045:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137052:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137058:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0000 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:2.0:1783138266.137063:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137071:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137084:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882f5b900) 00010000:00010000:2.0:1783138266.137087:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138266.137091:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137098:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9817b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137123:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137128:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137133:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137138:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0c00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:2.0:1783138266.137140:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137146:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137154:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff955882be8800) 00010000:00010000:2.0:1783138266.137156:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138266.137158:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137163:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98182 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137207:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98174 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969d5 expref: 12 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137218:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882f5b900) 00010000:00010000:2.0:1783138266.137220:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783138266.137231:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1400/0x6bc248e9a4e98174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969d5 expref: 12 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.137241:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba1400, rc 0) 00000100:00100000:2.0:1783138266.137326:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+11:18727:x1869755311092736:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 828us (1150us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1783138266.137334:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:3.0:1783138266.144102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.144245:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311092864 00000100:00100000:1.0:1783138266.144255:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311092864 00000100:00100000:1.0:1783138266.144327:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1783138266.144339:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+11:18727:x1869755311092864:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783138266.144365:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138266.144385:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98190 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969dc expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.144482:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.144498:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.144509:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138266.144549:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783138266.144553:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783138266.144571:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.144598:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa2a00/0x6bc248e9a4e98190 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 13 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.144616:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.144687:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:1.0:1783138266.144690:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783138266.144694:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa3000, rc 0) 00000100:00100000:1.0:1783138266.144753:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+12:18727:x1869755311092864:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 415us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.144761:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:3.0:1783138266.145887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.145990:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311092992 00000100:00100000:2.0:1783138266.145998:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311092992 00000100:00100000:2.0:1783138266.146044:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 159 00000100:00100000:2.0:1783138266.146055:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+11:18093:x1869755311092992:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138266.146067:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138266.146083:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff955783ba1400/0x6bc248e9a4e9819e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969e3 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.146107:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff955783ba1400/0x6bc248e9a4e9819e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969e3 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.146117:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff955783ba1400/0x6bc248e9a4e9819e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969e3 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.146125:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba1400, rc 0) 00000100:00100000:2.0:1783138266.146179:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18093:x1869755311092992:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 127us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.146185:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 159 00000100:00100000:0.0:1783138266.147810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138266.147883:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311093120 00000100:00100000:3.0:1783138266.147891:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311093120 00000100:00100000:3.0:1783138266.147949:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1783138266.147958:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+12:18727:x1869755311093120:12345-192.168.201.6@tcp:37:lfs.0 00000100:00100000:3.0:1783138266.149852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138266.150725:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+12:18727:x1869755311093120:12345-192.168.201.6@tcp:37:lfs.0 Request processed in 2757us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.150739:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1783138266.152898:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311093248 00000100:00100000:1.0:1783138266.152912:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311093248 00000100:00100000:1.0:1783138266.152975:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 160 00000100:00100000:1.0:1783138266.152983:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18093:x1869755311093248:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138266.153130:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18093:x1869755311093248:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 147us (3773us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.153137:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 160 00000100:00100000:3.0:1783138266.153917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.154729:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311093504 00000100:00100000:1.0:1783138266.154739:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311093504 00000100:00100000:1.0:1783138266.154797:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1783138266.154808:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b1f95450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+12:18727:x1869755311093504:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1783138266.155545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.155733:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b1f95450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+13:18727:x1869755311093504:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 926us (1818us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1783138266.155743:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1783138266.156296:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311093632 00000100:00100000:0.0:1783138266.156309:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311093632 00000100:00100000:0.0:1783138266.156349:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:0.0:1783138266.156358:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18093:x1869755311093632:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138266.156470:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18093:x1869755311093632:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 112us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.156476:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:2.0:1783138266.164211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.164385:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311093760 00000100:00100000:1.0:1783138266.164396:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311093760 00000100:00100000:1.0:1783138266.164459:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:1.0:1783138266.164471:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588bcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+12:18093:x1869755311093760:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138266.164505:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138266.164523:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e981a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969ea expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.164553:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e981a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ea expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.164566:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9558b6fa2a00/0x6bc248e9a4e981a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ea expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.164576:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b6fa2a00, rc 0) 00000100:00100000:1.0:1783138266.164676:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588bcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18093:x1869755311093760:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 207us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.164684:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 162 00010000:00010000:2.0:1783138266.165122:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138266.166897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.166979:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311093888 00000100:00100000:1.0:1783138266.166988:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311093888 00000100:00100000:1.0:1783138266.167046:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:1.0:1783138266.167057:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18093:x1869755311093888:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138266.167244:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18093:x1869755311093888:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 188us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.167252:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:3.0:1783138266.171955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.173189:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311094016 00000100:00100000:1.0:1783138266.173203:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311094016 00000100:00100000:1.0:1783138266.173279:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:1.0:1783138266.173293:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18093:x1869755311094016:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138266.173453:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9768c8db-2837-4b37-8344-aa5fc6411a75+13:18093:x1869755311094016:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 162us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.173469:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:3.0:1783138266.229082:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783138266.229107:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333224064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783138266.229182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138266.229229:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333224192:0@lo:400:kworker.0 00000100:00100000:3.0:1783138266.229258:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138266.229356:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333224192 00000100:00100000:2.0:1783138266.229364:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333224192 00000100:00100000:2.0:1783138266.229410:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783138266.229419:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3648:x1869755333224192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.229486:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b284ceb2-ce2c-470b-94d2-4ecc5b43a384+24:3648:x1869755333224192:12345-0@lo:400:kworker.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.229494:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783138266.229529:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333224576:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.229554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138266.229579:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333225088:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.229600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138266.229612:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bcb3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869755333225600:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.229647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138266.229668:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783138266.229674:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333224704:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.229695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138266.229728:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333225216:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.229750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138266.229756:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333224064 00000100:00100000:0.0:1783138266.229761:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333224064 00000100:00100000:2.0:1783138266.229767:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138266.229777:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333225728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138266.229802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138266.229808:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333225728 00000100:00100000:0.0:1783138266.229827:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333225728 00000100:00100000:0.0:1783138266.229846:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783138266.229856:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333224064:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138266.229865:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333225088 00000100:00100000:2.0:1783138266.229871:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333225088 00002000:00000024:0.0:1783138266.229878:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1783138266.229896:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333225600 00000100:00100000:2.0:1783138266.229899:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333225600 00000100:00100000:2.0:1783138266.229918:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333224704 00000100:00100000:2.0:1783138266.229922:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333224704 00000100:00100000:0.0:1783138266.229923:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869755333224064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.229946:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333225216 00000100:00100000:0.0:1783138266.229947:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783138266.229951:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333225216 00000100:00100000:0.0:1783138266.229967:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783138266.229975:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783138266.229979:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333225728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138266.229987:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333225088:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1783138266.230008:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1783138266.230035:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869755333225088:12345-0@lo:400:kworker.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.230048:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333225728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.230052:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783138266.230060:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783138266.230074:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783138266.230084:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869755333225600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.230088:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333224448:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230125:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869755333225600:12345-0@lo:400:kworker.0 Request processed in 43us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.230132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138266.230137:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783138266.230150:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783138266.230155:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333224704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230179:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869755333224704:12345-0@lo:400:kworker.0 Request processed in 23us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.230184:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783138266.230196:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783138266.230208:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333225216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230233:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869755333225216:12345-0@lo:400:kworker.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.230239:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783138266.230278:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333225728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138266.230290:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869755333224704:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230300:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869755333225216:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230319:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869755333225088:0@lo:400:kworker.0 00010000:00080000:2.0:1783138266.230334:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9558bcb3e300 x1869755333225600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138266.230345:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333224960:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230347:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bcb3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869755333225600:0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.230377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138266.230398:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869755333225472:0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.230421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138266.230446:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783138266.230453:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333224320:0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.230475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138266.230493:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333224832:0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.230514:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138266.230528:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869755333225344:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230545:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333225472 00000100:00100000:2.0:1783138266.230550:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333225472 00000100:00100000:0.0:1783138266.230554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138266.230581:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333225344 00000100:00100000:2.0:1783138266.230585:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333225344 00000100:00100000:0.0:1783138266.230593:0:25112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333224576 00000100:00100000:0.0:1783138266.230599:0:25112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333224576 00000100:00100000:2.0:1783138266.230605:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783138266.230615:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869755333225472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.230647:0:25112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333224448 00000100:00100000:0.0:1783138266.230652:0:25112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333224448 00000100:00100000:0.0:1783138266.230677:0:25112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333224960 00000100:00100000:0.0:1783138266.230681:0:25112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333224960 00000100:00100000:2.0:1783138266.230687:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869755333225472:12345-0@lo:400:kworker.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.230694:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783138266.230701:0:25112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138266.230710:0:25112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589809d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333224576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230714:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783138266.230725:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869755333225344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.230757:0:25112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589809d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333224576:12345-0@lo:400:kworker.0 Request processed in 48us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.230769:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869755333225344:12345-0@lo:400:kworker.0 Request processed in 44us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.230776:0:25112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783138266.230783:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1783138266.230835:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9558b6d70380 x1869755333225344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138266.230845:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869755333225344:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230865:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558ace4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869755333225472:0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.230911:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333224576:0@lo:400:kworker.0 00000100:00100000:3.0:1783138266.231053:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783138266.231062:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333224448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138266.231139:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783138266.231160:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333224960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138266.237185:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333224320 00000100:00100000:2.0:1783138266.237202:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333224320 00000100:00100000:2.0:1783138266.237262:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333224832 00000100:00100000:2.0:1783138266.237266:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333224832 00000100:00100000:2.0:1783138266.237285:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783138266.237294:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333224320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138266.237685:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333224448:12345-0@lo:400:kworker.0 Request processed in 6622us (7553us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138266.237697:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783138266.237749:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333224448:0@lo:400:kworker.0 00000100:00100000:3.0:1783138266.237800:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b284ceb2-ce2c-470b-94d2-4ecc5b43a384:3648:1869755333224192:0@lo:400:kworker.0 00000100:00100000:3.0:1783138266.237834:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869755333224064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783138266.237866:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783138266.237874:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333224832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138266.237911:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333224832:12345-0@lo:400:kworker.0 Request processed in 38us (7396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138266.237917:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783138266.237959:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333224832:0@lo:400:kworker.0 00000100:00080000:3.0:1783138266.239344:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783138266.239354:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783138266.239367:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783138266.239370:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783138266.240444:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138266.240487:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311094144 00000100:00100000:3.0:1783138266.240495:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311094144 00000100:00100000:3.0:1783138266.240541:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1783138266.240551:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+11:18735:x1869755311094144:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1783138266.240584:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138266.240602:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e981ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969f1 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240678:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240693:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240714:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240726:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240734:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240740:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240841:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043e00/0x6bc248e9a4e981c1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240850:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043e00/0x6bc248e9a4e981c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240856:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043e00/0x6bc248e9a4e981c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138266.240893:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783138266.240903:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138266.240940:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043e00/0x6bc248e9a4e981c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240952:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240958:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240965:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240970:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2042e00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138266.240974:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240981:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.240994:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882f5b900) 00010000:00010000:3.0:1783138266.240997:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138266.241001:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241008:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042e00/0x6bc248e9a4e981b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241023:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241028:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241043:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241047:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558c2042400 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138266.241050:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241055:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241063:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff955882be8800) 00010000:00010000:3.0:1783138266.241065:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138266.241068:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241073:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042400/0x6bc248e9a4e981ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241098:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042c00/0x6bc248e9a4e981ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f1 expref: 13 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241110:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2043e00/0x6bc248e9a4e981c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f1 expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.241117:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:3.0:1783138266.241119:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783138266.241121:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558c2043e00, rc 0) 00000100:00100000:3.0:1783138266.241174:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+12:18735:x1869755311094144:12345-192.168.201.6@tcp:101:bash.0 Request processed in 625us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138266.241190:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:1.0:1783138266.242872:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869755333224960:12345-0@lo:400:kworker.0 Request processed in 11711us (12491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.242886:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783138266.242932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.243031:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333224320:12345-0@lo:400:kworker.0 Request processed in 5735us (12551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.243041:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783138266.243049:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333224320:0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.243066:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869755333224960:0@lo:400:kworker.0 00000100:00100000:0.0:1783138266.243100:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311094272 00000100:00100000:0.0:1783138266.243105:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311094272 00000100:00100000:0.0:1783138266.243208:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1783138266.243218:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:92abdb97-8e98-4553-a110-233a98850940+5:18735:x1869755311094272:12345-192.168.201.6@tcp:900:bash.0 00000100:00100000:0.0:1783138266.243272:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:92abdb97-8e98-4553-a110-233a98850940+5:18735:x1869755311094272:12345-192.168.201.6@tcp:900:bash.0 Request processed in 57us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.243279:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783138266.248013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138266.248429:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311094528 00000100:00100000:3.0:1783138266.248439:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311094528 00000100:00100000:3.0:1783138266.248503:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1783138266.248513:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+12:18735:x1869755311094528:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1783138266.248533:0:24301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138266.248552:0:24301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e981c8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969f8 expref: -99 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.248698:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.248715:0:24301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.248724:0:24301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.248759:0:24301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.248774:0:24301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 12 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138266.248789:0:24301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bcb0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24301:1869755333225856:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783138266.248889:0:24301:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1f8a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138266.254169:0:24301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bcb0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24301:1869755333225856:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783138266.254208:0:24301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138266.255414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138266.255466:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311094656 00000100:00100000:3.0:1783138266.255474:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311094656 00010000:00010000:3.0:1783138266.255512:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 13 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138266.255559:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1783138266.255569:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+13:2409:x1869755311094656:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138266.255583:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138266.255590:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 13 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.255603:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 13 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.255623:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3000/0x6bc248e9a4e98197 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969dc expref: 13 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.255808:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:3.0:1783138266.255825:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.255835:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.256071:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.256195:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138266.256272:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+12:2409:x1869755311094656:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 696us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138266.256281:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00010000:00010000:2.0:1783138266.256821:0:24301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.256830:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.257336:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.257351:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.257361:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258120:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258133:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258140:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138266.258162:0:24301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783138266.258337:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258345:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258352:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258359:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302b200 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:2.0:1783138266.258363:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258371:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258384:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:2.0:1783138266.258387:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138266.258391:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258397:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e981cf lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783138266.258410:0:24301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbb24605 reply state 00000000f6182aa2 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258421:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258438:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff955882f5b600) 00010000:00010000:2.0:1783138266.258440:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783138266.258442:0:24301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783138266.258476:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558c2042a00/0x6bc248e9a4e981c8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 15 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258491:0:24301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 14 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.258499:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:2.0:1783138266.258501:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783138266.258504:0:24301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba1000, rc 0) 00000100:00100000:2.0:1783138266.258993:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+15:18735:x1869755311094528:12345-192.168.201.6@tcp:101:bash.0 Request processed in 10479us (10989us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1783138266.259003:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:0.0:1783138266.282376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138266.282673:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311094784 00000100:00100000:3.0:1783138266.282684:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311094784 00000100:00100000:3.0:1783138266.282752:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1783138266.282762:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+15:18735:x1869755311094784:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1783138266.282788:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138266.282807:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e981eb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b969ff expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.282896:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.282910:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.282922:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138266.282970:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783138266.282975:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138266.282993:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.283003:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.283027:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e981eb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.283062:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.283072:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138266.283075:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783138266.283078:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302ae00, rc 0) 00000100:00100000:3.0:1783138266.283210:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+16:18735:x1869755311094784:12345-192.168.201.6@tcp:101:bash.0 Request processed in 382us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138266.283218:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:1.0:1783138266.286521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000040:00080000:2.0:1783138266.293336:0:23528:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783138266.307883:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311095040 00000100:00100000:3.0:1783138266.307898:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311095040 00000100:00100000:3.0:1783138266.308025:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:3.0:1783138266.308037:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+16:18735:x1869755311095040:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:3.0:1783138266.308352:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+17:18735:x1869755311095040:12345-192.168.201.6@tcp:35:bash.0 Request processed in 317us (21838us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1783138266.308361:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1783138266.418981:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138266.419215:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311095296 00000100:00100000:0.0:1783138266.419225:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311095296 00000100:00100000:0.0:1783138266.419290:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1783138266.419311:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+17:18745:x1869755311095296:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783138266.419338:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138266.419358:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597600/0x6bc248e9a4e981f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a06 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138266.419452:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783138266.419674:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597600/0x6bc248e9a4e981f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a06 expref: 19 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.419686:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff955882f5b900) 00010000:00010000:0.0:1783138266.419699:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783138266.419704:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597600/0x6bc248e9a4e981f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a06 expref: 19 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.419714:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558a5597600, rc 0) 00000100:00100000:0.0:1783138266.419880:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+18:18745:x1869755311095296:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 573us (902us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1783138266.419888:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1783138266.434035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.434505:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311095552 00000100:00100000:1.0:1783138266.434515:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311095552 00000100:00100000:1.0:1783138266.434587:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1783138266.434598:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9557838ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92abdb97-8e98-4553-a110-233a98850940+18:18745:x1869755311095552:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783138266.435069:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9557838ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92abdb97-8e98-4553-a110-233a98850940+19:18745:x1869755311095552:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 472us (1042us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1783138266.435078:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1783138266.500178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.502340:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311095808 00000100:00100000:2.0:1783138266.502354:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311095808 00000100:00100000:2.0:1783138266.502623:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1783138266.502683:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+19:18748:x1869755311095808:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783138266.502709:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138266.502732:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98207 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a0d expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.502850:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e9820e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.502889:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e9820e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.502901:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e9820e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138266.502914:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783138266.503023:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98207 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a0d expref: 22 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.503042:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e9820e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a0d expref: 21 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.503051:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:2.0:1783138266.503054:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783138266.503059:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba0c00, rc 0) 00000100:00100000:2.0:1783138266.503118:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+21:18748:x1869755311095808:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 440us (2952us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1783138266.503126:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:0.0:1783138266.521969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138266.522035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.522093:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311095936 00000100:00100000:2.0:1783138266.522103:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311095936 00000100:00100000:2.0:1783138266.522172:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:1.0:1783138266.522173:0:25802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311096064 00000100:00100000:1.0:1783138266.522179:0:25802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311096064 00000100:00100000:1.0:1783138266.522240:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783138266.522249:0:25802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92abdb97-8e98-4553-a110-233a98850940+22:2411:x1869755311096064:12345-192.168.201.6@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783138266.522265:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+22:18748:x1869755311095936:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1783138266.522279:0:25802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138266.522306:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e9820e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a0d expref: 22 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.522344:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.522345:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:1.0:1783138266.522354:0:25802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783138266.522366:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.522391:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138266.522422:0:25802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92abdb97-8e98-4553-a110-233a98850940+21:2411:x1869755311096064:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 174us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.522431:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00010000:00010000:0.0:1783138266.523086:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.523096:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.523104:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.523110:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0000 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:0.0:1783138266.523114:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.523122:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.523132:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:0.0:1783138266.523134:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783138266.523138:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.523152:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9821c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138266.523480:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+20:18748:x1869755311095936:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 1223us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138266.523489:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:0.0:1783138266.531494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.531607:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311096320 00000100:00100000:1.0:1783138266.531617:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311096320 00000100:00100000:1.0:1783138266.532204:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783138266.532215:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b7174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92abdb97-8e98-4553-a110-233a98850940+20:18748:x1869755311096320:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783138266.532500:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b7174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92abdb97-8e98-4553-a110-233a98850940+21:18748:x1869755311096320:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 286us (1014us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1783138266.532509:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000040:00080000:2.0:1783138266.549355:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783138266.905734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138266.905861:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311096576 00000100:00100000:3.0:1783138266.905872:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311096576 00000100:00100000:3.0:1783138266.905946:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:3.0:1783138266.905956:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+21:18779:x1869755311096576:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:3.0:1783138266.905982:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138266.906004:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98223 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a14 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.906132:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e9822a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.906161:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e9822a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.906174:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e9822a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138266.906185:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783138266.906321:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98223 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a14 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.906343:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e9822a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a14 expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.906353:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138266.906356:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783138266.906359:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302b000, rc 0) 00000100:00100000:3.0:1783138266.906426:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+23:18779:x1869755311096576:12345-192.168.201.6@tcp:101:cat.0 Request processed in 471us (703us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1783138266.906434:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:2.0:1783138266.909979:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138266.910218:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311096704 00000100:00100000:3.0:1783138266.910227:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311096704 00000100:00100000:3.0:1783138266.910305:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1783138266.910316:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92abdb97-8e98-4553-a110-233a98850940+23:2412:x1869755311096704:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138266.910333:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138266.910360:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e9822a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a14 expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138266.910398:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138266.910404:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138266.910469:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92abdb97-8e98-4553-a110-233a98850940+22:2412:x1869755311096704:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 155us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138266.910476:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1783138266.912049:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.912309:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311096960 00000100:00100000:1.0:1783138266.912319:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311096960 00000100:00100000:1.0:1783138266.912418:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1783138266.912429:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+22:18779:x1869755311096960:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:1.0:1783138266.912776:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+23:18779:x1869755311096960:12345-192.168.201.6@tcp:35:cat.0 Request processed in 347us (732us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1783138266.912785:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1783138266.981492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138266.981597:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311097216 00000100:00100000:0.0:1783138266.981606:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311097216 00000100:00100000:0.0:1783138266.981702:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:0.0:1783138266.981712:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+23:18785:x1869755311097216:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:0.0:1783138266.981938:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138266.981962:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596e00/0x6bc248e9a4e98238 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a1b expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.982076:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.982091:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 24 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.982099:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.982106:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.982143:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.982171:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 24 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138266.982184:0:22771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b7177800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333225984:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783138266.984464:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 24 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.984483:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 24 pid: 24301 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138266.984498:0:22771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784068a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333226112:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783138266.984552:0:22771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138266.988287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138266.988340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138266.988437:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311097472 00000100:00100000:1.0:1783138266.988446:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311097472 00010000:00010000:1.0:1783138266.988486:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 25 pid: 24301 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138266.988540:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311097344 00000100:00100000:1.0:1783138266.988543:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311097344 00010000:00010000:1.0:1783138266.988557:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 26 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138266.988577:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1783138266.988586:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92abdb97-8e98-4553-a110-233a98850940+26:2410:x1869755311097472:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138266.988602:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138266.988609:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 26 pid: 24301 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988619:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 26 pid: 24301 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988664:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:1.0:1783138266.988669:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988677:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988684:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138266.988733:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92abdb97-8e98-4553-a110-233a98850940+26:2410:x1869755311097472:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 147us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.988753:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1783138266.988771:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1783138266.988778:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955882b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92abdb97-8e98-4553-a110-233a98850940+25:2410:x1869755311097344:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138266.988791:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138266.988796:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 25 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988820:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 25 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988831:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:1.0:1783138266.988835:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988843:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988860:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.988878:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138266.988898:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955882b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92abdb97-8e98-4553-a110-233a98850940+25:2410:x1869755311097344:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 120us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138266.988905:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00010000:00010000:0.0:1783138266.990098:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e981f2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969ff expref: 24 pid: 22772 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138266.990120:0:22771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b7177800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333225984:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783138266.990133:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e981dd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b969f8 expref: 23 pid: 24301 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138266.990142:0:22771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784068a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333226112:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783138266.990160:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.990168:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.990183:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138266.990201:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783138266.990461:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596e00/0x6bc248e9a4e98238 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a1b expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.990476:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5597e00/0x6bc248e9a4e9823f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a1b expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138266.990484:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:0.0:1783138266.990487:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783138266.990490:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558a5597e00, rc 0) 00000100:00100000:0.0:1783138266.990545:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+23:18785:x1869755311097216:12345-192.168.201.6@tcp:101:dd.0 Request processed in 8834us (9063us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1783138266.990553:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:3.0:1783138266.993162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138266.993694:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311097600 00000100:00100000:2.0:1783138266.993704:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311097600 00000100:00100000:2.0:1783138266.993877:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1783138266.993888:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+23:18785:x1869755311097600:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:2.0:1783138266.993911:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138266.993930:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0800/0x6bc248e9a4e9824d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a22 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.993960:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.993975:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.993984:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.994100:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0800/0x6bc248e9a4e9824d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 25 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.994117:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138266.994136:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:2.0:1783138266.994139:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783138266.994142:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba1800, rc 0) 00000100:00100000:2.0:1783138266.994202:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+24:18785:x1869755311097600:12345-192.168.201.6@tcp:101:dd.0 Request processed in 316us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138266.994209:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:3.0:1783138266.997222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138266.998042:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311097856 00000100:00100000:0.0:1783138266.998053:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311097856 00000100:00100000:1.0:1783138266.998289:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:1.0:1783138266.998307:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+24:18785:x1869755311097856:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:1.0:1783138266.998536:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.998555:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.998588:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783138266.998666:0:24301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1783138266.998692:0:24301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005053f66b reply state 000000006f37c0c4 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.998707:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138266.998715:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:1.0:1783138266.998719:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783138266.998721:0:24301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783138266.999010:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+27:18785:x1869755311097856:12345-192.168.201.6@tcp:36:dd.0 Request processed in 703us (1795us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1783138266.999019:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000020:00080000:1.0:1783138266.999024:0:24301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783138267.000954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.001032:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311097984 00000100:00100000:3.0:1783138267.001042:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311097984 00000100:00100000:3.0:1783138267.001113:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1783138267.001123:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+27:18785:x1869755311097984:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:3.0:1783138267.001146:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138267.001164:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98262 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a29 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.001215:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98262 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a29 expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.001229:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98262 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a29 expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.001247:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138267.001250:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783138267.001277:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302b200, rc 0) 00000100:00100000:3.0:1783138267.001339:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+28:18785:x1869755311097984:12345-192.168.201.6@tcp:101:dd.0 Request processed in 217us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.001346:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00080000:1.0:1783138267.001535:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783138267.012005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.014141:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311098240 00000100:00100000:2.0:1783138267.014167:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311098240 00000100:00100000:2.0:1783138267.014268:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1783138267.014279:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92abdb97-8e98-4553-a110-233a98850940+28:18785:x1869755311098240:12345-192.168.201.6@tcp:103:dd.0 00010000:00010000:2.0:1783138267.014302:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138267.014333:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98262 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a29 expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.014372:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:2.0:1783138267.014378:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138267.014542:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92abdb97-8e98-4553-a110-233a98850940+27:18785:x1869755311098240:12345-192.168.201.6@tcp:103:dd.0 Request processed in 263us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.014550:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1783138267.020236:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138267.020373:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311098368 00000100:00100000:1.0:1783138267.020385:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311098368 00000100:00100000:1.0:1783138267.020485:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1783138267.020493:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+27:18785:x1869755311098368:12345-192.168.201.6@tcp:58:dd.0 00010000:00010000:1.0:1783138267.020581:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.020595:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.020604:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138267.021620:0:24301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138267.021682:0:24301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1783138267.024218:0:24301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1783138267.024466:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+27:18785:x1869755311098368:12345-192.168.201.6@tcp:58:dd.0 Request processed in 3967us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138267.024477:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:3.0:1783138267.026257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138267.028189:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311098496 00000100:00100000:1.0:1783138267.028203:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311098496 00000100:00100000:3.0:1783138267.028417:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:3.0:1783138267.028431:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+27:18785:x1869755311098496:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:3.0:1783138267.028453:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138267.028473:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a30 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.028529:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.028542:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a30 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.028562:0:22772:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.028576:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a30 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.028589:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138267.028592:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783138267.028597:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a30 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.028644:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302b000, rc 0) 00000100:00100000:3.0:1783138267.028707:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+28:18785:x1869755311098496:12345-192.168.201.6@tcp:101:dd.0 Request processed in 280us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.028715:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00010000:00010000:2.0:1783138267.188788:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138267.368760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.368863:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311098752 00000100:00100000:3.0:1783138267.368873:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311098752 00000100:00100000:3.0:1783138267.368948:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:3.0:1783138267.368959:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+28:2412:x1869755311098752:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783138267.369052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.369077:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+28:2412:x1869755311098752:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 118us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.369087:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:0.0:1783138267.369284:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311099008 00000100:00100000:0.0:1783138267.369289:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311099008 00000100:00100000:2.0:1783138267.369382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138267.369387:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783138267.369397:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92abdb97-8e98-4553-a110-233a98850940+5:2412:x1869755311099008:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783138267.369412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783138267.369439:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92abdb97-8e98-4553-a110-233a98850940+5:2412:x1869755311099008:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 43us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138267.369447:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783138267.369462:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311099520 00000100:00100000:0.0:1783138267.369466:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311099520 00000100:00100000:2.0:1783138267.369479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.369503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.369528:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.369550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.369574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00080000:1.0:1783138267.372979:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138267.373014:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311099136 00000100:00100000:1.0:1783138267.373024:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311099136 00000100:00100000:1.0:1783138267.373100:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311099648 00000100:00100000:1.0:1783138267.373104:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311099648 00000100:00100000:1.0:1783138267.373133:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1783138267.373144:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92abdb97-8e98-4553-a110-233a98850940+5:2412:x1869755311099136:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783138267.373228:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92abdb97-8e98-4553-a110-233a98850940+5:2412:x1869755311099136:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 86us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138267.373236:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1783138267.373253:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:1.0:1783138267.373724:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2412:x1869755311099648:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783138267.373758:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2412:x1869755311099648:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 39us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138267.373765:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00080000:1.0:1783138267.373783:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783138267.373958:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311099264 00000100:00100000:2.0:1783138267.373960:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311098880 00000100:00100000:3.0:1783138267.373965:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311099264 00000100:00100000:2.0:1783138267.373968:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311098880 00000100:00100000:2.0:1783138267.374012:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311099392 00000100:00100000:2.0:1783138267.374015:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311099392 00000100:00100000:2.0:1783138267.374035:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:2.0:1783138267.374044:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+5:2412:x1869755311098880:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783138267.374081:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1783138267.374087:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+5:2412:x1869755311098880:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 43us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.374093:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2412:x1869755311099392:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783138267.374101:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:2.0:1783138267.374128:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:2.0:1783138267.374135:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+12:2412:x1869755311099264:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783138267.374168:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+12:2412:x1869755311099264:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 34us (4788us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.374176:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:2.0:1783138267.374240:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311098624 00000100:00100000:2.0:1783138267.374245:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311098624 00000100:00100000:2.0:1783138267.374274:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:2.0:1783138267.374281:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b73e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+13:2412:x1869755311098624:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783138267.374308:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b73e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9768c8db-2837-4b37-8344-aa5fc6411a75+13:2412:x1869755311098624:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (4830us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.374315:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:0.0:1783138267.374423:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:0.0:1783138267.374433:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578430b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2412:x1869755311099520:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783138267.374463:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578430b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2412:x1869755311099520:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 33us (5051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138267.374470:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00080000:0.0:1783138267.374493:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783138267.374561:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783138267.379489:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0c4b748-a23d-4126-8d4e-17341ebd9d3a+5:2412:x1869755311099392:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 5387us (9925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.379571:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000040:00080000:2.0:1783138267.572846:0:22806:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783138267.572857:0:22806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783138267.572883:0:22806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1783138267.572894:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1783138267.573015:0:22806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa2b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22806:1869755333226240:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783138267.573107:0:22806:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138267.578401:0:22806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa2b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22806:1869755333226240:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783138267.580592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.580719:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311099776 00000100:00100000:3.0:1783138267.580728:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311099776 00000100:00100000:3.0:1783138267.580801:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:3.0:1783138267.580811:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+28:18786:x1869755311099776:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783138267.580846:0:22772:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783138267.580976:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+28:18786:x1869755311099776:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 166us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.580997:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1783138267.586868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.586949:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311099904 00000100:00100000:2.0:1783138267.586960:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311099904 00000100:00100000:2.0:1783138267.587016:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:2.0:1783138267.587024:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+28:18786:x1869755311099904:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783138267.587098:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587114:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587125:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587184:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587191:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587198:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587406:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587418:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587425:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138267.587478:0:24301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783138267.587482:0:24301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783138267.587506:0:24301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587518:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587525:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587532:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587537:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0c00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:2.0:1783138267.587541:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587548:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587560:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff955882be8e00) 00010000:00010000:2.0:1783138267.587569:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138267.587574:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587580:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e98277 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587594:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587599:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587605:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587611:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0600 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:2.0:1783138267.587614:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587620:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587675:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff955882f5bb00) 00010000:00010000:2.0:1783138267.587679:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138267.587682:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587687:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e9827e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587702:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587713:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587719:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587725:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0000 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:2.0:1783138267.587729:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587736:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587744:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:2.0:1783138267.587746:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138267.587749:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.587754:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e98285 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.587832:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+28:18786:x1869755311099904:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 807us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.587840:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1783138267.599000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.599255:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311100160 00000100:00100000:3.0:1783138267.599266:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311100160 00000100:00100000:3.0:1783138267.599358:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1783138267.599368:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+28:18786:x1869755311100160:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783138267.599391:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138267.599411:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e9828c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a37 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599511:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599525:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599537:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138267.599559:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783138267.599662:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599669:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599675:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599681:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302b200 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138267.599684:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599705:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599717:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138267.599719:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783138267.599723:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599728:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e98293 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599765:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e9828c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a37 expref: 30 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599774:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff955882be8e00) 00010000:00010000:3.0:1783138267.599776:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783138267.599780:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e9828c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a37 expref: 30 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.599800:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302a000, rc 0) 00000100:00100000:3.0:1783138267.599865:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+29:18786:x1869755311100160:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 498us (874us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1783138267.599873:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1783138267.602990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.604475:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311100288 00000100:00100000:2.0:1783138267.604489:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311100288 00000100:00100000:2.0:1783138267.604616:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:2.0:1783138267.604650:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+29:18786:x1869755311100288:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783138267.604690:0:22773:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783138267.604839:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+29:18786:x1869755311100288:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 213us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.604848:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:1.0:1783138267.611857:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.612078:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311100544 00000100:00100000:2.0:1783138267.612090:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311100544 00000100:00100000:2.0:1783138267.612146:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1783138267.612156:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+29:18786:x1869755311100544:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783138267.612176:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138267.612198:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982a1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a3e expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783138267.612876:0:22771:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1783138267.612884:0:22771:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1783138267.612906:0:22771:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1783138267.613054:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e982a8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.613070:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e982a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.613081:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e982a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.613139:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982a1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a3e expref: 32 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.613157:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e982a8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a3e expref: 31 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.613181:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5bb00) 00010000:00010000:2.0:1783138267.613184:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783138267.613187:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba0600, rc 0) 00000100:00100000:2.0:1783138267.613410:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+31:18786:x1869755311100544:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1254us (1564us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1783138267.613419:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:3.0:1783138267.624340:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138267.624502:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311100800 00000100:00100000:1.0:1783138267.624512:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311100800 00000100:00100000:1.0:1783138267.624584:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1783138267.624595:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+31:18786:x1869755311100800:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783138267.624695:0:24301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138267.624724:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0600/0x6bc248e9a4e982a8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a3e expref: 31 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624743:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5bb00) 00010000:00010000:1.0:1783138267.624754:0:24301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783138267.624780:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624803:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624814:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624832:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624837:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624843:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624893:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624917:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624923:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624928:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7156200 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138267.624932:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624939:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624949:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:1.0:1783138267.624952:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138267.624956:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624961:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156200/0x6bc248e9a4e982b6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624971:0:24301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624976:0:24301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624981:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.624986:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7156e00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138267.624994:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.625001:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.625008:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xaf9a8bea (ffff955882be8200) 00010000:00010000:1.0:1783138267.625011:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138267.625013:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.625018:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982bd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaf9a8bea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138267.625105:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+30:18786:x1869755311100800:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 511us (784us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783138267.625113:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:0.0:1783138267.628371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.628457:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311100928 00000100:00100000:2.0:1783138267.628467:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311100928 00000100:00100000:2.0:1783138267.628521:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1783138267.628531:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+30:18786:x1869755311100928:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783138267.628562:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138267.628584:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982c4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a45 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.628619:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e982cb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.628669:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e982cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.628681:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e982cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.628814:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982c4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a45 expref: 32 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.628833:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0c00/0x6bc248e9a4e982cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a45 expref: 31 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.628849:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:2.0:1783138267.628853:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783138267.628856:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba0c00, rc 0) 00000100:00100000:2.0:1783138267.628908:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+31:18786:x1869755311100928:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 378us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.628916:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:3.0:1783138267.634417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138267.634583:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311101184 00000100:00100000:1.0:1783138267.634596:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311101184 00000100:00100000:1.0:1783138267.634862:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:1.0:1783138267.634874:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+31:18786:x1869755311101184:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783138267.634972:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.634988:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.635000:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138267.635316:0:24301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1783138267.635352:0:24301:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736606722087ns, next at 737606719734ns, rc = 0 00000004:00010000:1.0:1783138267.635411:0:24301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da0bc596 reply state 00000000040e9dc6 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.635426:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.635434:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:1.0:1783138267.635437:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783138267.635441:0:24301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783138267.635819:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+33:18786:x1869755311101184:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 669us (1135us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1783138267.635829:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:1.0:1783138267.640923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.641248:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311101312 00000100:00100000:2.0:1783138267.641862:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311101312 00000100:00100000:2.0:1783138267.641993:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:2.0:1783138267.642005:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+33:18786:x1869755311101312:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783138267.642046:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138267.642069:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a4c expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.642132:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 34 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.642148:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 34 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.642170:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:2.0:1783138267.642173:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783138267.642177:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba0000, rc 0) 00000100:00100000:2.0:1783138267.642264:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+34:18786:x1869755311101312:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 261us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.643676:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:0.0:1783138267.649128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.649249:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311101440 00000100:00100000:3.0:1783138267.649522:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311101440 00000100:00100000:3.0:1783138267.649607:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:3.0:1783138267.649618:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92abdb97-8e98-4553-a110-233a98850940+5:2411:x1869755311101440:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783138267.652239:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92abdb97-8e98-4553-a110-233a98850940+6:2411:x1869755311101440:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 2602us (3101us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1783138267.652260:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1783138267.659716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.660011:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311101696 00000100:00100000:2.0:1783138267.660021:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311101696 00000100:00100000:2.0:1783138267.660122:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1783138267.660133:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92abdb97-8e98-4553-a110-233a98850940+34:18786:x1869755311101696:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783138267.660368:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92abdb97-8e98-4553-a110-233a98850940+35:18786:x1869755311101696:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 236us (661us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1783138267.660375:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1783138267.668914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.669329:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311101952 00000100:00100000:3.0:1783138267.669340:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311101952 00000100:00100000:3.0:1783138267.669403:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:3.0:1783138267.669414:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+35:18786:x1869755311101952:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783138267.669561:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+35:18786:x1869755311101952:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 148us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.669569:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:0.0:1783138267.675127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.675248:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311102080 00000100:00100000:3.0:1783138267.675267:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311102080 00000100:00100000:3.0:1783138267.675452:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1783138267.675462:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955784068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+35:18786:x1869755311102080:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783138267.675482:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138267.675501:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e982e0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a53 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.675569:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e982e7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.675583:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e982e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.675595:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e982e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138267.675671:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138267.675690:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e982e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.675728:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e982e0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a53 expref: 37 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.675746:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e982e7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a53 expref: 36 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.675754:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:3.0:1783138267.675757:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783138267.675760:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95588302b200, rc 0) 00000100:00100000:3.0:1783138267.675825:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955784068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+36:18786:x1869755311102080:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 364us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.675833:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:0.0:1783138267.681901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.681982:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311102208 00000100:00100000:2.0:1783138267.681991:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311102208 00000100:00100000:2.0:1783138267.682052:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:2.0:1783138267.682067:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92abdb97-8e98-4553-a110-233a98850940+6:2409:x1869755311102208:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783138267.682084:0:24278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138267.682107:0:24278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a5a expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783138267.682132:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4887db, blocks: 0x0 00010000:00010000:2.0:1783138267.682153:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1783138267.682157:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138267.682166:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 7 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.682184:0:24278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 7 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.682216:0:24278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba0e00, rc 0) 00000100:00100000:2.0:1783138267.682295:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92abdb97-8e98-4553-a110-233a98850940+7:2409:x1869755311102208:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 234us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.682302:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:1.0:1783138267.688554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.688967:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311102464 00000100:00100000:3.0:1783138267.688977:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311102464 00000100:00100000:3.0:1783138267.689083:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:3.0:1783138267.689096:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+36:18786:x1869755311102464:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783138267.689211:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92abdb97-8e98-4553-a110-233a98850940+36:18786:x1869755311102464:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 118us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.689219:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:0.0:1783138267.697776:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.697984:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311102592 00000100:00100000:3.0:1783138267.697995:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311102592 00000100:00100000:3.0:1783138267.698059:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1783138267.698070:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+36:18786:x1869755311102592:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783138267.705215:0:22752:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1783138267.705235:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1783138267.705296:0:22752:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1783138267.705466:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.705495:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.705504:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.705510:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0a00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138267.705515:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.705523:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.705542:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:3.0:1783138267.705545:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783138267.705550:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.705557:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0a00/0x6bc248e9a4e9816d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.705958:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92abdb97-8e98-4553-a110-233a98850940+19:18786:x1869755311102592:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 7885us (8189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.705986:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1783138267.706052:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333226368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783138267.706105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138267.706770:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333226368 00000100:00100000:2.0:1783138267.706779:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333226368 00000100:00100000:2.0:1783138267.706841:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783138267.706849:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95578421aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869755333226368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783138267.706985:0:24280:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783138267.706989:0:24280:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1783138267.706991:0:24280:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783138267.706993:0:24280:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1783138267 -> 1783138267 00002000:00010000:2.0:1783138267.706996:0:24280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783138267.707037:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95578421aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869755333226368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (931us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1783138267.707045:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1783138267.707127:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9558baa2ad80/2, rc 0, transno 12884901892 00000100:00100000:3.0:1783138267.707134:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869755333226368:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1783138267.709059:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709076:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709085:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709094:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa3200 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138267.709098:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709104:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709138:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff955882be8800) 00010000:00010000:1.0:1783138267.709141:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138267.709146:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709153:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3200/0x6bc248e9a4e9810b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709175:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709181:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709186:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709190:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b6fa3800 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138267.709193:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709198:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709205:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff955882be8000) 00010000:00010000:1.0:1783138267.709206:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138267.709209:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709214:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b6fa3800/0x6bc248e9a4e98119 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709237:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709243:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709248:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709265:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba1c00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138267.709268:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709272:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709292:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff955882f5b600) 00010000:00010000:1.0:1783138267.709294:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138267.709297:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709303:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1c00/0x6bc248e9a4e981d6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709317:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709323:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709328:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709339:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7157c00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138267.709342:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709349:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709357:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:1.0:1783138267.709359:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138267.709362:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709367:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157c00/0x6bc248e9a4e9825b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709379:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709385:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709391:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709395:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7156e00 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:1.0:1783138267.709398:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709403:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709429:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:1.0:1783138267.709432:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783138267.709435:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.709442:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7156e00/0x6bc248e9a4e982d2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138267.713972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.714066:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311102720 00000100:00100000:3.0:1783138267.714076:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311102720 00000100:00100000:3.0:1783138267.714135:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:3.0:1783138267.714146:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92abdb97-8e98-4553-a110-233a98850940+7:2410:x1869755311102720:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783138267.714289:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92abdb97-8e98-4553-a110-233a98850940+7:2410:x1869755311102720:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.714296:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:1.0:1783138267.726731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.726981:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311102976 00000100:00100000:2.0:1783138267.726992:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311102976 00000100:00100000:2.0:1783138267.727052:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1783138267.727062:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+15:18786:x1869755311102976:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783138267.727117:0:24301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138267.727155:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b200/0x6bc248e9a4e982e7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a53 expref: 15 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.727174:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:2.0:1783138267.727179:0:24301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783138267.727207:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0800/0x6bc248e9a4e982f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.727221:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0800/0x6bc248e9a4e982f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.727231:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0800/0x6bc248e9a4e982f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783138267.727376:0:24301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ba86edb reply state 0000000070a2e3f5 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0800/0x6bc248e9a4e982f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.727388:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0800/0x6bc248e9a4e982f5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.727395:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:2.0:1783138267.727397:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783138267.727400:0:24301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783138267.727548:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+16:18786:x1869755311102976:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 487us (826us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1783138267.727555:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1783138267.731179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138267.731293:0:24753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311103104 00000100:00100000:1.0:1783138267.731304:0:24753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311103104 00000100:00100000:1.0:1783138267.731361:0:24753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1783138267.731370:0:24753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92abdb97-8e98-4553-a110-233a98850940+7:18786:x1869755311103104:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783138267.731387:0:24753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138267.731404:0:24753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a61 expref: -99 pid: 24753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.731443:0:24753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 8 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.731453:0:24753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138267.731457:0:24753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138267.731462:0:24753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 8 pid: 24753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.731495:0:24753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 8 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.731524:0:24753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 8 pid: 24278 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138267.731538:0:24753:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bcb3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24753:1869755333226496:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783138267.731619:0:24753:0:(client.c:2701:ptlrpc_set_wait()) set ffff955882c18900 going to sleep for 11 seconds 00000100:00100000:1.0:1783138267.735275:0:24753:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bcb3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24753:1869755333226496:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783138267.735322:0:24753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 8 pid: 24753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.735343:0:24753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9558b7156e00, rc 0) 00000100:00100000:1.0:1783138267.735530:0:24753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92abdb97-8e98-4553-a110-233a98850940+8:18786:x1869755311103104:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 4160us (4359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138267.735540:0:24753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1783138267.740180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.740381:0:25802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311103232 00000100:00100000:2.0:1783138267.740393:0:25802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311103232 00010000:00010000:2.0:1783138267.740447:0:25802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 8 pid: 24278 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.740510:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:2.0:1783138267.740520:0:25802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92abdb97-8e98-4553-a110-233a98850940+8:2410:x1869755311103232:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783138267.740535:0:25802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138267.740556:0:25802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 8 pid: 24278 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.740569:0:25802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 8 pid: 24278 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.740591:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e982ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a5a expref: 8 pid: 24278 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.740609:0:25802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138267.740613:0:25802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138267.740620:0:25802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 7 pid: 24753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.740678:0:25802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 7 pid: 24753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.740718:0:25802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 7 pid: 24753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.740745:0:25802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa29880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25802:1869755333226624:192.168.201.6@tcp:105: 00000100:00100000:2.0:1783138267.740834:0:25802:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138267.745730:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.745886:0:25112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311103360 00000100:00100000:3.0:1783138267.745894:0:25112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311103360 00000100:00100000:3.0:1783138267.745955:0:25112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:3.0:1783138267.745973:0:25112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558ace4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92abdb97-8e98-4553-a110-233a98850940+8:2410:x1869755311103360:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783138267.746117:0:25112:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783138267.746121:0:25112:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1783138267 00002000:00010000:3.0:1783138267.746123:0:25112:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1783138266 00002000:00010000:3.0:1783138267.746126:0:25112:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1783138267 -> 1783138267 00002000:00010000:3.0:1783138267.746128:0:25112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1783138267.746182:0:25112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558ace4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92abdb97-8e98-4553-a110-233a98850940+9:2410:x1869755311103360:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 218us (461us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1783138267.746189:0:25112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1783138267.750125:0:25802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa29880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25802:1869755333226624:192.168.201.6@tcp:105: 00010000:00010000:2.0:1783138267.750155:0:25802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138267.750378:0:25802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92abdb97-8e98-4553-a110-233a98850940+8:2410:x1869755311103232:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 9858us (10205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.750390:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1783138267.750612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.751002:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311103488 00000100:00100000:2.0:1783138267.751010:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311103488 00000100:00100000:2.0:1783138267.751055:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:2.0:1783138267.751065:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558bcb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92abdb97-8e98-4553-a110-233a98850940+8:2409:x1869755311103488:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783138267.751108:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.751126:0:24278:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 8 pid: 24753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.751135:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138267.751139:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783138267.751143:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.751174:0:24278:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 8 pid: 24753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.751209:0:24278:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 8 pid: 24753 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.751222:0:24278:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24278:1869755333226752:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783138267.751298:0:24278:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138267.755166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.755238:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311103616 00000100:00100000:3.0:1783138267.755247:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311103616 00010000:00010000:3.0:1783138267.755298:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 9 pid: 24753 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138267.755340:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1783138267.755351:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92abdb97-8e98-4553-a110-233a98850940+9:2409:x1869755311103616:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138267.755364:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138267.755384:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 9 pid: 24753 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.755430:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 9 pid: 24753 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.755457:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783138267.755461:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783138267.755467:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.755476:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.755497:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138267.755549:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92abdb97-8e98-4553-a110-233a98850940+9:2409:x1869755311103616:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 199us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.755557:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00010000:00010000:2.0:1783138267.756943:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e200bd51/0x6bc248e9a4e982fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a61 expref: 8 pid: 24753 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.756964:0:24278:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24278:1869755333226752:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783138267.756986:0:24278:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.756998:0:24278:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.758521:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.758558:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.758568:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.758600:0:24278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.758606:0:24278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0e00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138267.758610:0:24278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.758618:0:24278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.758666:0:24278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.758674:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd2174b0/0x6bc248e9a4e98303 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.758770:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558bcb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92abdb97-8e98-4553-a110-233a98850940+7:2409:x1869755311103488:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 7703us (8156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.758780:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:0.0:1783138267.764191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.764272:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311103872 00000100:00100000:2.0:1783138267.764288:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311103872 00000100:00100000:2.0:1783138267.764344:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:2.0:1783138267.764352:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+16:18786:x1869755311103872:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783138267.764436:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.764465:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.764475:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.764505:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.764518:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 16 pid: 22772 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.764532:0:22771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558baa29880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333226880:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783138267.764612:0:22771:0:(client.c:2701:ptlrpc_set_wait()) set ffff955890d5b180 going to sleep for 11 seconds 00000100:00100000:0.0:1783138267.767180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.767300:0:22771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558baa29880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333226880:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783138267.767337:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138267.767610:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311104000 00000100:00100000:3.0:1783138267.767618:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311104000 00010000:00010000:3.0:1783138267.767699:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 17 pid: 22772 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138267.767729:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1783138267.767738:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92abdb97-8e98-4553-a110-233a98850940+17:2410:x1869755311104000:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138267.767753:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138267.767758:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 17 pid: 22772 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.767798:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 17 pid: 22772 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.767820:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1800/0x6bc248e9a4e98254 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a22 expref: 17 pid: 22772 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.767835:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138267.767841:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a30 expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.767851:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.767858:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.767866:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.767885:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138267.767934:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92abdb97-8e98-4553-a110-233a98850940+16:2410:x1869755311104000:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 196us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138267.767942:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00010000:00010000:0.0:1783138267.768024:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.768042:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.768242:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.768265:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 16 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.768273:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.768308:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 16 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.768320:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 16 pid: 22771 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138267.768331:0:22771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333227008:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783138267.768381:0:22771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558888a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1783138267.771587:0:22771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333227008:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783138267.771620:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138267.776929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.777019:0:25802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311104128 00000100:00100000:2.0:1783138267.777031:0:25802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311104128 00010000:00010000:2.0:1783138267.777073:0:25802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 17 pid: 22771 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.777139:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1783138267.777150:0:25802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95588951a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92abdb97-8e98-4553-a110-233a98850940+17:2410:x1869755311104128:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783138267.777165:0:25802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138267.777172:0:25802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 17 pid: 22771 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.777185:0:25802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 17 pid: 22771 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.777209:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e982d9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a4c expref: 17 pid: 22771 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.777225:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:2.0:1783138267.777230:0:25802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.777241:0:25802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.777249:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.777294:0:25802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138267.777358:0:25802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95588951a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:92abdb97-8e98-4553-a110-233a98850940+16:2410:x1869755311104128:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 209us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.777366:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00010000:00010000:0.0:1783138267.777772:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.777779:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783138267.777921:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1783138267.778050:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1783138267.778098:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1783138267.778177:0:22771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889518700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22771:1869755333227136:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783138267.778229:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138267.778366:0:22771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558898a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138267.779916:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333227136 00000100:00100000:3.0:1783138267.779929:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333227136 00000100:00100000:3.0:1783138267.779986:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783138267.779997:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22771:x1869755333227136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783138267.780174:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22771:x1869755333227136:12345-0@lo:1000:mdt00_000.0 Request processed in 178us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138267.780183:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783138267.780369:0:22771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889518700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22771:1869755333227136:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783138267.780525:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1783138267.780589:0:22771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955889518700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22771:1869755333227264:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783138267.780617:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138267.780696:0:22771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b5d0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1783138267.780742:0:23513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333227264 00000100:00100000:2.0:1783138267.780751:0:23513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333227264 00000100:00100000:2.0:1783138267.780806:0:23513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783138267.780811:0:23513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b17c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22771:x1869755333227264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783138267.780913:0:23513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b17c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22771:x1869755333227264:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (294us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1783138267.780919:0:23513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783138267.780954:0:22771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955889518700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22771:1869755333227264:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783138267.780993:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781002:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781009:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781014:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558a5596600 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138267.781018:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781026:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781042:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:3.0:1783138267.781045:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783138267.781049:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781053:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558a5596600/0x6bc248e9a4e98311 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781078:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781082:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781086:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781094:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9558b7157200 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138267.781096:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781100:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781106:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138267.781107:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783138267.781112:0:22771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a30 expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781121:0:22771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a30 expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781127:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a30 expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.781163:0:22771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95588302b000/0x6bc248e9a4e98270 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a30 expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138267.781513:0:22771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333227392:192.168.201.6@tcp:105: 00000100:00100000:3.0:1783138267.781596:0:22771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9558b1f8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783138267.784837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138267.785030:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311104256 00000100:00100000:1.0:1783138267.785039:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311104256 00000100:00100000:1.0:1783138267.785099:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1783138267.785110:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95589073f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+20:18785:x1869755311104256:12345-192.168.201.6@tcp:49:dd.0 00000100:00100000:1.0:1783138267.785242:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95589073f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+20:18785:x1869755311104256:12345-192.168.201.6@tcp:49:dd.0 Request processed in 133us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138267.785271:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1783138267.785613:0:22771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22771:1869755333227392:192.168.201.6@tcp:105: 00010000:00010000:3.0:1783138267.785683:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785706:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9558b7157200/0x6bc248e9a4e98269 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785807:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785824:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785837:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785848:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785856:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785862:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785868:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302a000 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138267.785871:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785879:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785890:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138267.785893:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138267.785898:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785912:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302a000/0x6bc248e9a4e98318 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785924:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785929:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785933:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785938:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba1000 already unused, calling callback (ffffffffc189c4f0) 00010000:00010000:3.0:1783138267.785941:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785946:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785954:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:3.0:1783138267.785955:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783138267.785958:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.785964:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba1000/0x6bc248e9a4e9830a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138267.786122:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92abdb97-8e98-4553-a110-233a98850940+19:18786:x1869755311103872:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 21770us (21940us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1783138267.786132:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000020:00080000:3.0:1783138267.786141:0:22771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783138267.786171:0:22806:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783138267.786176:0:22806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783138267.786211:0:22806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1783138267.786221:0:22806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1783138267.789063:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.789157:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311104384 00000100:00100000:2.0:1783138267.789166:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311104384 00000100:00100000:2.0:1783138267.789232:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:2.0:1783138267.789244:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff955889f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+19:18785:x1869755311104384:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:2.0:1783138267.789275:0:24301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138267.789306:0:24301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9831f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x434e03dd49b96a68 expref: -99 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.789344:0:24301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0e00/0x6bc248e9a4e98326 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.789357:0:24301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0e00/0x6bc248e9a4e98326 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.789367:0:24301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0e00/0x6bc248e9a4e98326 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.789480:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0000/0x6bc248e9a4e9831f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a68 expref: 21 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.789510:0:24301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff955783ba0e00/0x6bc248e9a4e98326 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x434e03dd49b96a68 expref: 20 pid: 24301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.789518:0:24301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff955882f5b700) 00010000:00010000:2.0:1783138267.789521:0:24301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783138267.789524:0:24301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff955783ba0e00, rc 0) 00000100:00100000:2.0:1783138267.789582:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff955889f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92abdb97-8e98-4553-a110-233a98850940+20:18785:x1869755311104384:12345-192.168.201.6@tcp:101:dd.0 Request processed in 340us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138267.789590:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:0.0:1783138267.791162:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783138267.791605:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311104640 00000100:00100000:3.0:1783138267.791615:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311104640 00000100:00100000:3.0:1783138267.791706:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:3.0:1783138267.791716:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+20:18786:x1869755311104640:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783138267.791977:0:22774:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783138267.792010:0:22774:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1783138267.792040:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.792057:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.792066:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.792076:0:22774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.792082:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.792089:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.792104:0:22774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783138267.792179:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92abdb97-8e98-4553-a110-233a98850940+22:18786:x1869755311104640:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 465us (1023us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1783138267.792187:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000020:00080000:3.0:1783138267.792191:0:22774:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783138267.792666:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138267.792674:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.792682:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302ae00 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:0.0:1783138267.792686:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.792694:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.792708:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff955882f5b500) 00010000:00010000:0.0:1783138267.792711:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783138267.792715:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.792722:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95588302ae00/0x6bc248e9a4e9832d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138267.792752:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138267.792754:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138267.792767:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138267.816172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783138267.816325:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311104768 00000100:00100000:2.0:1783138267.816335:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311104768 00000100:00100000:2.0:1783138267.816433:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1783138267.816442:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92abdb97-8e98-4553-a110-233a98850940+7:2409:x1869755311104768:12345-192.168.201.6@tcp:4:dd.0 00002000:00010000:2.0:1783138267.816485:0:24283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a4887db, atime: 0x6a4887da, ctime: 0x6a4887db, blocks: 0x0 00010000:00010000:2.0:1783138267.816494:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.816510:0:24283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1783138267.816514:0:24283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138267.816520:0:24283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.816534:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138267.821015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783138267.822325:0:24284:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1783138267.823026:0:24284:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1783138267.823034:0:24285:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783138267.823057:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755311104896 00000100:00100000:3.0:1783138267.823067:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755311104896 00000100:00100000:3.0:1783138267.824056:0:25820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1783138267.824067:0:25820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:92abdb97-8e98-4553-a110-233a98850940+8:2409:x1869755311104896:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:3.0:1783138267.824102:0:25820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.824117:0:25820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138267.824120:0:25820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138267.824124:0:25820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138267.824134:0:25820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783138267.881747:0:25096:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:1.0:1783138267.881769:0:25096:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1783138267.882141:0:24283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1783138267.882146:0:24283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1783138267 -> 1783138268 00002000:00010000:2.0:1783138267.882149:0:24283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1783138267 -> 1783138268 00002000:00010000:2.0:1783138267.882151:0:24283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1783138267.882169:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.882184:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.882194:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.882201:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff955783ba0000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:2.0:1783138267.882206:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.882216:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.882243:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138267.882311:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b43f8aa/0x6bc248e9a4e98334 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138267.882544:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92abdb97-8e98-4553-a110-233a98850940+7:2409:x1869755311104768:12345-192.168.201.6@tcp:4:dd.0 Request processed in 66096us (66377us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1783138267.882554:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000001:00080000:0.0:1783138267.922405:0:25096:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:1.0:1783138267.922728:0:25820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1783138267.922734:0:25820:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1783138267.922752:0:25820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.922764:0:25820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.922773:0:25820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.922779:0:25820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95588302a000 already unused, calling callback (ffffffffc0c92ce0) 00010000:00010000:1.0:1783138267.922795:0:25820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.922805:0:25820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.922825:0:25820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138267.922833:0:25820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e43dbc4/0x6bc248e9a4e9833b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138267.922998:0:25820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:92abdb97-8e98-4553-a110-233a98850940+5:2409:x1869755311104896:12345-192.168.201.6@tcp:4:dd.0 Request processed in 98927us (101986us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1783138267.923009:0:25820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00010000:00010000:2.0:1783138268.212861:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138269.236826:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138269.316586:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138269.316615:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bcb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333227520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783138269.316717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138269.316828:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333227520 00000100:00100000:1.0:1783138269.316836:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333227520 00000100:00100000:1.0:1783138269.316900:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783138269.316910:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333227520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783138269.316946:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783138269.317000:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869755333227520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138269.317007:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1783138269.317028:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138269.317082:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bcb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869755333227520:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1783138269.596347:0:25857:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1783138270.260944:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138270.324891:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138270.324917:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558b6d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333227904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783138270.324999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138270.325099:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333227904 00000100:00100000:0.0:1783138270.325107:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333227904 00000100:00100000:0.0:1783138270.325194:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783138270.325204:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558b6d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333227904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783138270.325243:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138270.325287:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558b6d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869755333227904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138270.325294:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783138270.325341:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558b6d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869755333227904:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783138270.325370:0:22767:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783138270.325509:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff955784219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333227648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138270.325542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138270.325562:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138270.325567:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9558bcb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333227776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138270.325584:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138270.325607:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333227648 00000100:00100000:2.0:1783138270.325610:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333227648 00000100:00100000:2.0:1783138270.325653:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755333227776 00000100:00100000:2.0:1783138270.325656:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755333227776 00000100:00100000:2.0:1783138270.325668:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783138270.325673:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333227648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783138270.325698:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1783138270.325728:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869755333227648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138270.325734:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783138270.325758:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783138270.325763:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9558baa28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333227776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138270.325793:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138270.325818:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9558baa28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869755333227776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138270.325824:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783138270.325852:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9558bcb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869755333227776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138270.325861:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff955784219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869755333227648:0@lo:41:osp-pre-0-1.0 Debug log: 14032 lines, 14032 kept, 0 dropped, 0 bad.