00000100:00100000:3.0F:1788941033.415288:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941033.415368:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0F:1788941033.415451:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075970816 00000100:00100000:1.0:1788941033.415466:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075970816 00000100:00100000:1.0:1788941033.415533:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788941033.415545:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+8:2405:x1875840075970816:12345-192.168.201.42@tcp:16:kworker.0 00000100:00100000:1.0:1788941033.415716:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+8:2405:x1875840075970816:12345-192.168.201.42@tcp:16:kworker.0 Request processed in 172us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941033.415724:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:2.0F:1788941033.416173:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075970688 00000100:00100000:2.0:1788941033.416185:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075970688 00002000:00100000:2.0:1788941033.416214:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff99cac7c68700 x1875840075970688/t0(0) o4->ac24e1ff-e60c-4c44-9273-4a80f445e0f5@192.168.201.42@tcp:254/0 lens 504/0 e 0 to 0 dl 1788941044 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788941033.416225:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99cac7c68700 with x1875840075970688 ext(0->8) 00002000:00010000:2.0:1788941033.416232:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cac7c68700 00000100:00100000:2.0:1788941033.416258:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788941033.416266:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+8:2405:x1875840075970688:12345-192.168.201.42@tcp:4:bash.0 00000100:00080000:3.0:1788941033.416811:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788941033.419621:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+10:2405:x1875840075970688:12345-192.168.201.42@tcp:4:bash.0 Request processed in 3343us (4240us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788941033.419641:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:1.0:1788941033.419654:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff99cac7c68700 x1875840075970688/t8589934599(0) o4->ac24e1ff-e60c-4c44-9273-4a80f445e0f5@192.168.201.42@tcp:254/0 lens 504/448 e 0 to 0 dl 1788941044 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788941033.419674:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99cac7c68700 with x1875840075970688 ext(0->8) 00002000:00010000:1.0:1788941033.419681:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cac7c68700 00010000:00010000:0.0F:1788941033.860932:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941034.373232:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788941034.373264:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac19fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102264064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788941034.373351:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941034.373517:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102264064 00000100:00100000:2.0:1788941034.373527:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102264064 00000100:00100000:2.0:1788941034.373595:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788941034.373604:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102264064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788941034.373634:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941034.373678:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102264064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941034.373685:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788941034.373731:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788941034.373788:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac19fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102264064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788941034.883955:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941035.397968:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102264192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941035.398041:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941035.398282:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102264192 00000100:00100000:2.0:1788941035.398291:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102264192 00000100:00100000:2.0:1788941035.398476:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788941035.398486:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102264192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788941035.398511:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941035.398587:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102264192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941035.398596:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788941035.398621:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941035.398884:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102264192:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1788941035.403460:0:19443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788941035.403476:0:19443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1788941035.404793:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:0.0:1788941035.404823:0:17102:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cbfecd3d80 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1788941035.404828:0:17102:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cbcb244e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cbfecd3900 00000020:00080000:0.0:1788941035.404864:0:17102:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cbcb244c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cac6a84400 00010000:00010000:1.0:1788941035.404892:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b800/0x24b6539075b3eaed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788941035.404896:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:1.0:1788941035.404908:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b800/0x24b6539075b3eaed lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941035.404917:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b800/0x24b6539075b3eaed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941035.404923:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09b800 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941035.404929:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b800/0x24b6539075b3eaed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941035.404938:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b800/0x24b6539075b3eaed lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941035.404981:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cac6855f00) 00010000:00010000:1.0:1788941035.404984:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941035.404991:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b800/0x24b6539075b3eaed lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788941035.404991:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788941035.405000:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b800/0x24b6539075b3eaed lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941035.908183:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac19f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102264320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941035.908323:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941035.908393:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102264320 00000100:00100000:2.0:1788941035.908401:0:19458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102264320 00000100:00100000:2.0:1788941035.908460:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788941035.908469:0:19458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac19fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102264320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788941035.908533:0:19458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788941035.908582:0:19458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac19fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102264320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941035.908589:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788941035.908636:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac19f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102264320:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788941035.912393:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941035.912424:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102264448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941035.912491:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941035.912558:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102264448 00000100:00100000:1.0:1788941035.912567:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102264448 00000100:00100000:1.0:1788941035.912609:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788941035.912618:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102264448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941035.912658:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788941035.912708:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102264448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941035.912715:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788941035.912764:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102264448:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788941036.036759:0:17876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788941036.507137:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507193:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507215:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507239:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507262:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507298:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507313:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507335:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.507363:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075971200 00000100:00100000:3.0:1788941036.507372:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075971200 00000100:00100000:3.0:1788941036.507439:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075971584 00000100:00100000:3.0:1788941036.507442:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075971584 00000100:00100000:3.0:1788941036.507456:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075971072 00000100:00100000:3.0:1788941036.507458:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075971072 00000100:00100000:3.0:1788941036.507470:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075971712 00000100:00100000:3.0:1788941036.507472:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075971712 00000100:00100000:3.0:1788941036.507490:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:3.0:1788941036.507509:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+5:2406:x1875840075971200:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941036.507589:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+5:2406:x1875840075971200:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 91us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941036.507597:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:3.0:1788941036.507616:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:3.0:1788941036.507622:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+6:2406:x1875840075971584:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941036.507646:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+6:2406:x1875840075971584:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941036.507664:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:3.0:1788941036.507677:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:3.0:1788941036.507684:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+12:2406:x1875840075971072:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941036.507710:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+12:2406:x1875840075971072:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941036.507716:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:3.0:1788941036.507727:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:3.0:1788941036.507733:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+5:2406:x1875840075971712:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941036.507754:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+5:2406:x1875840075971712:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941036.507759:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:3.0:1788941036.507776:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075971456 00000100:00100000:3.0:1788941036.507779:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075971456 00000100:00100000:3.0:1788941036.507797:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075971328 00000100:00100000:3.0:1788941036.507800:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075971328 00000100:00100000:3.0:1788941036.507812:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075971840 00000100:00100000:3.0:1788941036.507814:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075971840 00000100:00100000:3.0:1788941036.507824:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075971968 00000100:00100000:3.0:1788941036.507826:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075971968 00000100:00100000:3.0:1788941036.507864:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788941036.507872:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+6:2406:x1875840075971456:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941036.507898:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+6:2406:x1875840075971456:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941036.507904:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788941036.507915:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788941036.507927:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+5:2402:x1875840075971328:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:3.0:1788941036.507946:0:18629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e7a5 00000100:00080000:3.0:1788941036.507962:0:18629:0:(import.c:65:import_set_state_nolock()) ffff99cac5a70800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788941036.508009:0:18629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788941036.508140:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+2:2402:x1875840075971328:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 212us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941036.508147:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788941036.508159:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:3.0:1788941036.508165:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+5:2402:x1875840075971840:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:3.0:1788941036.508176:0:18629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e7e4 00000100:00080000:3.0:1788941036.508183:0:18629:0:(import.c:65:import_set_state_nolock()) ffff99cbe5755000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788941036.508204:0:18629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788941036.508254:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+2:2402:x1875840075971840:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 89us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941036.508261:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:3.0:1788941036.508272:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788941036.508279:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+5:2402:x1875840075971968:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:3.0:1788941036.508288:0:18629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e7eb 00000100:00080000:3.0:1788941036.508295:0:18629:0:(import.c:65:import_set_state_nolock()) ffff99cbe5757800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788941036.508335:0:18629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788941036.508407:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+2:2402:x1875840075971968:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 128us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941036.508414:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00080000:3.0:1788941036.508448:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788941036.508452:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788941036.508461:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941036.508464:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788941036.508675:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941036.508682:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941036.508687:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941036.508762:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075970944 00000100:00100000:2.0:1788941036.508770:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075970944 00000100:00100000:2.0:1788941036.508816:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:2.0:1788941036.508824:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac192c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+13:2406:x1875840075970944:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941036.508879:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac192c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+13:2406:x1875840075970944:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 56us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941036.508887:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:3.0:1788941036.729932:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941036.730112:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075972096 00000100:00100000:2.0:1788941036.730125:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075972096 00000100:00100000:2.0:1788941036.730218:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:2.0:1788941036.730230:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+12:15578:x1875840075972096:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788941036.730414:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+12:15578:x1875840075972096:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 187us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941036.730423:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:2.0:1788941036.737025:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941036.737150:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075972224 00000100:00100000:1.0:1788941036.737160:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075972224 00000100:00100000:1.0:1788941036.737260:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:1.0:1788941036.737335:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac19f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+5:15578:x1875840075972224:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788941036.737452:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac19f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+5:15578:x1875840075972224:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 183us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941036.737482:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:1.0:1788941036.738772:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941036.739035:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075972480 00000100:00100000:3.0:1788941036.739042:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075972480 00000100:00100000:3.0:1788941036.739082:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788941036.739092:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+12:15578:x1875840075972480:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788941036.739305:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+13:15578:x1875840075972480:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 214us (538us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788941036.739313:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00010000:00010000:3.0:1788941036.932139:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941037.444626:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102264576:0@lo:400:kworker.0 00000100:00100000:3.0:1788941037.444706:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.444763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102265088:0@lo:400:kworker.0 00000100:00100000:3.0:1788941037.444791:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.444812:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102265600:0@lo:400:kworker.0 00000100:00100000:3.0:1788941037.444832:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.444868:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102266112:0@lo:400:kworker.0 00000100:00100000:3.0:1788941037.444887:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.444907:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788941037.444912:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102264704:0@lo:400:kworker.0 00000100:00100000:3.0:1788941037.444933:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.444948:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102265216:0@lo:400:kworker.0 00000100:00100000:3.0:1788941037.445050:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.445074:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875840102265728:0@lo:400:kworker.0 00000100:00100000:3.0:1788941037.445093:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.445124:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102265088 00000100:00100000:3.0:1788941037.445133:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102265088 00000100:00100000:3.0:1788941037.445178:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102265600 00000100:00100000:3.0:1788941037.445181:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102265600 00000100:00100000:3.0:1788941037.445194:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102266112 00000100:00100000:3.0:1788941037.445197:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102266112 00000100:00100000:3.0:1788941037.445219:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102265728 00000100:00100000:3.0:1788941037.445222:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102265728 00000100:00100000:3.0:1788941037.445237:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788941037.445245:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102265088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445506:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102264832:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445536:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941037.445557:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102265344:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445578:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941037.445595:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102265856:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445614:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941037.445627:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788941037.445632:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102264960:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445651:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941037.445669:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102265472:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445688:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941037.445704:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac792a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875840102265984:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445724:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941037.445748:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102264832 00000100:00100000:1.0:1788941037.445752:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102264832 00000100:00100000:1.0:1788941037.445776:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102265344 00000100:00100000:1.0:1788941037.445779:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102265344 00000100:00100000:1.0:1788941037.445791:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102264960 00000100:00100000:1.0:1788941037.445793:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102264960 00000100:00100000:1.0:1788941037.445804:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102265472 00000100:00100000:1.0:1788941037.445806:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102265472 00000100:00100000:1.0:1788941037.445819:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788941037.445825:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102264832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445897:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102264832:12345-0@lo:400:kworker.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.445911:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788941037.445929:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788941037.445935:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102265344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.445962:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102265344:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.445968:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788941037.445979:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788941037.446098:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102265088:12345-0@lo:400:kworker.0 Request processed in 852us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941037.446105:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788941037.446117:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102265856 00000100:00100000:3.0:1788941037.446120:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102265856 00000100:00100000:3.0:1788941037.446134:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102265984 00000100:00100000:3.0:1788941037.446137:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102265984 00000100:00100000:3.0:1788941037.446240:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788941037.446248:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102265600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446330:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102264960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446361:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102264960:12345-0@lo:400:kworker.0 Request processed in 377us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.446367:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788941037.446377:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788941037.446383:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102265472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446407:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102265472:12345-0@lo:400:kworker.0 Request processed in 24us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.446412:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788941037.446451:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788941037.446457:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cac7e9ad80, transno 8589934596 00000004:00080000:1.0:1788941037.446466:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788941037.446497:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102264960:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446510:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102265472:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446519:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102264832:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446526:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102265344:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446576:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788941037.446584:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875840102266112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446618:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875840102266112:12345-0@lo:400:kworker.0 Request processed in 35us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.446624:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788941037.446637:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788941037.446643:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875840102265728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446669:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875840102265728:12345-0@lo:400:kworker.0 Request processed in 27us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.446675:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788941037.446686:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788941037.446692:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102265856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446722:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102265856:12345-0@lo:400:kworker.0 Request processed in 30us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.446727:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788941037.446738:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788941037.446744:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875840102265984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446768:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875840102265984:12345-0@lo:400:kworker.0 Request processed in 25us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.446774:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788941037.446791:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102264704 00000100:00100000:1.0:1788941037.446795:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102264704 00000100:00100000:1.0:1788941037.446816:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102265216 00000100:00100000:1.0:1788941037.446819:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102265216 00000100:00100000:1.0:1788941037.446850:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788941037.446858:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102264704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446895:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102264704:12345-0@lo:400:kworker.0 Request processed in 38us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.446901:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788941037.446913:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788941037.446919:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102265216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.446946:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102265216:12345-0@lo:400:kworker.0 Request processed in 28us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941037.446952:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788941037.446980:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac792a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875840102265984:0@lo:400:kworker.0 00010000:00080000:1.0:1788941037.447006:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac7928700 x1875840102265856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941037.447016:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102265856:0@lo:400:kworker.0 00000100:00080000:1.0:1788941037.447045:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788941037.447049:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788941037.447052:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788941037.447055:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788941037.447076:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102264704:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.447089:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102265216:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.447100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875840102265728:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.447111:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102265088:0@lo:400:kworker.0 00010000:00080000:1.0:1788941037.447122:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac7928380 x1875840102266112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941037.447131:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102266112:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.447165:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941037.447174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102266240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788941037.447201:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.447442:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102265600:12345-0@lo:400:kworker.0 Request processed in 1194us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941037.447451:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788941037.447537:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102264576 00000100:00100000:0.0:1788941037.447542:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102264576 00000100:00100000:0.0:1788941037.447582:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788941037.447589:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac192cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+24:3649:x1875840102264576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941037.447626:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac192cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+24:3649:x1875840102264576:12345-0@lo:400:kworker.0 Request processed in 38us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941037.447632:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788941037.448134:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102266240 00000100:00100000:2.0:1788941037.448140:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102266240 00000100:00100000:2.0:1788941037.448183:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788941037.448192:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102266240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788941037.448214:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788941037.448394:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102266240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941037.448402:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788941037.448736:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102266368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788941037.448770:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941037.448851:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102266368 00000100:00100000:3.0:1788941037.448857:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102266368 00000100:00100000:3.0:1788941037.448888:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788941037.448896:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102266368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788941037.448918:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788941037.448951:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102266368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941037.448957:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788941037.449097:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102266368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788941037.450610:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102266240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788941037.450630:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102264576:0@lo:400:kworker.0 00000100:00100000:1.0:1788941037.450644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102265600:0@lo:400:kworker.0 00010000:00010000:0.0:1788941037.965144:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788941038.576703:0:20499:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 04:03:56 (1788941036) 00010000:00010000:2.0:1788941038.980554:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941039.494297:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788941039.494321:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102266496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788941039.495195:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941039.495682:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102266496 00000100:00100000:2.0:1788941039.495693:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102266496 00000100:00100000:2.0:1788941039.496236:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788941039.496250:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac792b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102266496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788941039.496285:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788941039.496480:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941039.496732:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac792b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102266496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 485us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941039.496740:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788941039.497934:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102266496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788941040.006743:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941040.516665:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788941040.516689:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac792b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102266624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941040.516756:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941040.516863:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102266624 00000100:00100000:0.0:1788941040.516870:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102266624 00000100:00100000:0.0:1788941040.516945:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788941040.516954:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac19f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102266624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788941040.516975:0:18631:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941040.517020:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac19f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102266624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941040.517026:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788941040.517134:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941040.517174:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac792b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102266624:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788941040.710406:0:17158:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788941040.710414:0:17158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788941040.710445:0:17158:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788941040.710461:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788941041.028125:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac19f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102266752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788941041.028216:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941041.028329:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102266752 00000100:00100000:2.0:1788941041.028338:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102266752 00000100:00100000:2.0:1788941041.028396:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788941041.028406:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac792aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102266752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788941041.028448:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788941041.028524:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac792aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102266752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941041.028531:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788941041.028896:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac19f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102266752:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788941041.029109:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941041.029296:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac19f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102266880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941041.029331:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941041.029404:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102266880 00000100:00100000:2.0:1788941041.029410:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102266880 00000100:00100000:2.0:1788941041.029465:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788941041.029472:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102266880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788941041.029494:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788941041.029538:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102266880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941041.029544:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788941041.029708:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac19f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102266880:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788941041.549756:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788941041.549771:0:17102:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1788941041.549857:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1788941041.549869:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:0.0:1788941041.602241:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941041.602297:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941041.602396:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075972608 00000100:00100000:3.0:1788941041.602415:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075972608 00000100:00100000:3.0:1788941041.602479:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:3.0:1788941041.602490:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac192dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bf8ad97-92cf-4c14-8397-59cb869a8be2+13:2404:x1875840075972608:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941041.602567:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac192dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bf8ad97-92cf-4c14-8397-59cb869a8be2+13:2404:x1875840075972608:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 79us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941041.602574:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:0.0:1788941041.603434:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941041.612274:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941041.620457:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075972864 00000100:00100000:1.0:1788941041.620481:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075972864 00000100:00100000:1.0:1788941041.620655:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075973120 00000100:00100000:1.0:1788941041.620660:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075973120 00000100:00080000:2.0:1788941041.628217:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941041.628230:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788941041.628597:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941041.628654:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941041.628695:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075972736 00000100:00100000:0.0:1788941041.628705:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075972736 00000100:00100000:0.0:1788941041.628757:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075973248 00000100:00100000:0.0:1788941041.628772:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075973248 00000100:00100000:0.0:1788941041.628795:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:0.0:1788941041.628805:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+5:2404:x1875840075972864:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788941041.628904:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+5:2404:x1875840075972864:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 99us (26614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941041.628912:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:0.0:1788941041.628932:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:0.0:1788941041.628938:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+12:2404:x1875840075972736:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788941041.628970:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+12:2404:x1875840075972736:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (16708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941041.628976:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:0.0:1788941041.628988:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:0.0:1788941041.628994:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+5:2404:x1875840075973248:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788941041.629017:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+5:2404:x1875840075973248:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941041.629023:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:0.0:1788941041.629052:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075972992 00000100:00100000:0.0:1788941041.629056:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075972992 00000100:00100000:0.0:1788941041.629093:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:0.0:1788941041.629099:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+6:2404:x1875840075972992:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788941041.629125:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+6:2404:x1875840075972992:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941041.629131:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00080000:2.0:1788941041.632075:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788941041.632097:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941041.632101:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788941041.633129:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:1.0:1788941041.633144:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac792bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+6:2404:x1875840075973120:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941041.633229:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac792bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+6:2404:x1875840075973120:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 90us (29800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941041.633236:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00010000:00010000:0.0:1788941042.053779:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788941042.061126:0:19443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a77bf5ab-277e-4ce0-a8d9-86d9926c3288 00000020:00000080:1.0:1788941042.061135:0:19443:0:(genops.c:885:class_export_put()) final put ffff99cbe5751000/a77bf5ab-277e-4ce0-a8d9-86d9926c3288 00000020:00000080:3.0:1788941042.064269:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbe5751000/a77bf5ab-277e-4ce0-a8d9-86d9926c3288 for lustre-OST0001 00000020:00000080:3.0:1788941042.064343:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbe5757800 for lustre-OST0001 00000001:00100000:0.0:1788941042.073087:0:18624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a77bf5ab-277e-4ce0-a8d9-86d9926c3288 00000020:00000080:0.0:1788941042.073098:0:18624:0:(genops.c:885:class_export_put()) final put ffff99cbe5757000/a77bf5ab-277e-4ce0-a8d9-86d9926c3288 00000001:00100000:0.0:1788941042.073126:0:18624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac24e1ff-e60c-4c44-9273-4a80f445e0f5 00000020:00000080:0.0:1788941042.073129:0:18624:0:(genops.c:885:class_export_put()) final put ffff99cac5a71000/ac24e1ff-e60c-4c44-9273-4a80f445e0f5 00000020:00000080:1.0:1788941042.073190:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbe5757000/a77bf5ab-277e-4ce0-a8d9-86d9926c3288 for lustre-OST0000 00000020:00000080:1.0:1788941042.073241:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac5a71000/ac24e1ff-e60c-4c44-9273-4a80f445e0f5 for lustre-OST0000 00000020:00000080:1.0:1788941042.073260:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbe5755000 for lustre-OST0000 00000020:00000080:1.0:1788941042.073265:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac5a70800 for lustre-OST0000 00000100:00100000:3.0:1788941042.564284:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102267008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788941042.564284:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102267264:0@lo:400:kworker.0 00000100:00100000:2.0:1788941042.564365:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102267392:0@lo:400:kworker.0 00000100:00100000:1.0:1788941042.564445:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102267136:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.564952:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941042.565014:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102267520:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.565040:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941042.565062:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102268032:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.565079:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941042.565105:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875840102268544:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.565131:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941042.565189:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102268544 00000100:00100000:3.0:1788941042.565198:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102268544 00000100:00100000:3.0:1788941042.565266:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788941042.565276:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875840102268544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.567640:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941042.567722:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102267776:0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.567761:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941042.567780:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875840102268288:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.567786:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875840102268544:12345-0@lo:400:kworker.0 Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941042.567805:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941042.567808:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788941042.567850:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102268800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941042.567856:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102268288 00000100:00100000:3.0:1788941042.567863:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102268288 00000100:00100000:0.0:1788941042.567874:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941042.567903:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788941042.567910:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102267008 00000100:00100000:3.0:1788941042.567911:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac792b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875840102268288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.567913:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102267008 00000100:00100000:0.0:1788941042.567935:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102268800 00000100:00100000:0.0:1788941042.567937:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102268800 00000100:00100000:0.0:1788941042.567951:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788941042.567957:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102267008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788941042.567963:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac792b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875840102268288:12345-0@lo:400:kworker.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941042.567969:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00002000:00000024:0.0:1788941042.567979:0:18631:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00080000:3.0:1788941042.567997:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788941042.568002:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788941042.568011:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102267008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941042.568017:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788941042.568029:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788941042.568034:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102268800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941042.568036:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102267008:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788941042.568042:0:18631:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788941042.568050:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875840102268544:0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.568061:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102268800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 28us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941042.568081:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788941042.568096:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102267264 00000100:00100000:0.0:1788941042.568100:0:19458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102267264 00000100:00100000:3.0:1788941042.568110:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102267776 00000100:00100000:3.0:1788941042.568113:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102267776 00000100:00100000:0.0:1788941042.568123:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788941042.568128:0:19458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102267264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.568133:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788941042.568138:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102267776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.568161:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102267776:12345-0@lo:400:kworker.0 Request processed in 23us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941042.568176:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788941042.568210:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102267520 00000100:00100000:3.0:1788941042.568214:0:19043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102267520 00000100:00100000:3.0:1788941042.568235:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102268032 00000100:00100000:3.0:1788941042.568238:0:19043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102268032 00000100:00100000:3.0:1788941042.568253:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788941042.568259:0:19043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102267520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.568292:0:19043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102267520:12345-0@lo:400:kworker.0 Request processed in 33us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941042.568298:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788941042.568307:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788941042.568312:0:19043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102268032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.568708:0:19043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102268032:12345-0@lo:400:kworker.0 Request processed in 386us (3617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941042.568716:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788941042.568748:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102267520:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.568757:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102268032:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.569008:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102268800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941042.569019:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102267776:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.569026:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875840102268288:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.569491:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941042.569563:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102267904:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.569588:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941042.569720:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941042.569754:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102267648:0@lo:400:kworker.0 00000100:00100000:1.0:1788941042.569777:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941042.569807:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102268160:0@lo:400:kworker.0 00000100:00100000:1.0:1788941042.569831:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941042.569867:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102268672:0@lo:400:kworker.0 00000100:00100000:1.0:1788941042.569888:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941042.569931:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102267136 00000100:00100000:1.0:1788941042.569938:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102267136 00000100:00100000:1.0:1788941042.569979:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788941042.570867:0:19458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102267264:12345-0@lo:400:kworker.0 Request processed in 2731us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941042.570879:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788941042.570929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102267264:0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.570972:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102267648 00000100:00100000:0.0:1788941042.570977:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102267648 00000100:00100000:0.0:1788941042.571004:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102268160 00000100:00100000:0.0:1788941042.571007:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102268160 00000100:00100000:0.0:1788941042.571019:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102268672 00000100:00100000:0.0:1788941042.571022:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102268672 00000100:00100000:0.0:1788941042.571043:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788941042.571050:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102267648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.571106:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102267648:12345-0@lo:400:kworker.0 Request processed in 57us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941042.571112:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788941042.571124:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788941042.571129:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102268160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.571730:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102268160:12345-0@lo:400:kworker.0 Request processed in 598us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941042.571737:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788941042.571755:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788941042.571769:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875840102268672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.571799:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875840102268672:12345-0@lo:400:kworker.0 Request processed in 32us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941042.571805:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788941042.571827:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788941042.571914:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102267648:0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.571925:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102268160:0@lo:400:kworker.0 00010000:00080000:0.0:1788941042.571937:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe56e1880 x1875840102268672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941042.571947:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102268672:0@lo:400:kworker.0 00000100:00100000:1.0:1788941042.573607:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac192f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+24:3649:x1875840102267136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941042.573714:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac192f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+24:3649:x1875840102267136:12345-0@lo:400:kworker.0 Request processed in 3728us (3994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941042.573722:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788941042.573922:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102267136:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.576140:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102268416:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.576207:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941042.576278:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102268416 00000100:00100000:3.0:1788941042.576286:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102268416 00000100:00100000:3.0:1788941042.576343:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788941042.576352:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102268416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.576416:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102268416:12345-0@lo:400:kworker.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941042.576423:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1788941042.576462:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe56e1180 x1875840102268416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941042.576475:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102268416:0@lo:400:kworker.0 00000100:00080000:0.0:1788941042.576701:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788941042.579157:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102267392 00000100:00100000:2.0:1788941042.579174:0:19043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102267392 00000100:00100000:2.0:1788941042.579266:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102267904 00000100:00100000:2.0:1788941042.579269:0:19043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102267904 00000100:00100000:2.0:1788941042.579306:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788941042.579319:0:19043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102267392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941042.579444:0:19043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102267392:12345-0@lo:400:kworker.0 Request processed in 127us (9953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941042.579452:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788941042.579470:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788941042.579477:0:19043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102267904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941042.579504:0:19043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102267904:12345-0@lo:400:kworker.0 Request processed in 29us (9915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941042.579509:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788941042.580064:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788941042.580275:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102267392:0@lo:400:kworker.0 00000100:00100000:3.0:1788941042.580290:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102267904:0@lo:400:kworker.0 00000100:00100000:0.0:1788941042.837116:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941042.837168:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941042.837194:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941042.837279:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941042.837420:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075973376 00000100:00100000:2.0:1788941042.837432:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075973376 00000100:00100000:2.0:1788941042.837492:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075973632 00000100:00100000:2.0:1788941042.837496:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075973632 00000100:00100000:2.0:1788941042.837508:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075973504 00000100:00100000:2.0:1788941042.837510:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075973504 00000100:00100000:2.0:1788941042.837527:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:2.0:1788941042.837538:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+15:2406:x1875840075973376:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941042.837556:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941042.837583:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfeb1e600/0x24b6539075b3e782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c9408015180e expref: 15 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941042.837606:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941042.837664:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+14:2406:x1875840075973376:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 128us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941042.837671:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:2.0:1788941042.837687:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788941042.837693:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+13:2406:x1875840075973632:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941042.837718:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941042.837729:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc0031200/0x24b6539075b3e846 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801518f5 expref: 13 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941042.837737:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941042.837757:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+12:2406:x1875840075973632:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 65us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941042.837763:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788941042.837773:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788941042.837779:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac792a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+11:2406:x1875840075973504:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941042.837785:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941042.837793:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3e789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c9408015183f expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941042.837800:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941042.837814:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac792a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+10:2406:x1875840075973504:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 36us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941042.837819:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788941042.837977:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075973888 00000100:00100000:2.0:1788941042.837981:0:19043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075973888 00000100:00100000:2.0:1788941042.838008:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:2.0:1788941042.838015:0:19043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+6:2402:x1875840075973888:12345-192.168.201.42@tcp:9:umount.0 00000020:00000080:2.0:1788941042.838047:0:19043:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e7ac 00000020:00010000:2.0:1788941042.838057:0:19043:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cac5a70000: total 0 00000100:00080000:2.0:1788941042.838063:0:19043:0:(import.c:65:import_set_state_nolock()) ffff99cac78fb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788941042.838110:0:19043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788941042.838265:0:19043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+4:2402:x1875840075973888:12345-192.168.201.42@tcp:9:umount.0 Request processed in 250us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941042.838278:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000020:00010000:2.0:1788941042.838296:0:17111:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cac5a70000: total 0 00010000:00010000:2.0:1788941042.838299:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941042.838320:0:17111:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cac5a70000, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788941042.838354:0:17111:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788941042.838358:0:17111:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788941042.838379:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0041f7/0x24b6539075b3eb10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801519d5 expref: 3 pid: 18627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941042.838410:0:17111:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cac5a70000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788941042.838420:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941042.838422:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941042.838424:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941042.872921:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941042.873481:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075974784 00000100:00100000:3.0:1788941042.873496:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075974784 00000100:00100000:3.0:1788941042.873571:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:3.0:1788941042.873583:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+12:2402:x1875840075974784:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:3.0:1788941042.873618:0:17122:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e797 00000020:00010000:3.0:1788941042.873632:0:17122:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cac8433000: total 0 00000100:00080000:3.0:1788941042.873638:0:17122:0:(import.c:65:import_set_state_nolock()) ffff99cac8431000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788941042.873672:0:17122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:3.0:1788941042.873882:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+11:2402:x1875840075974784:12345-192.168.201.42@tcp:39:umount.0 Request processed in 301us (970us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1788941042.873891:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000020:00010000:1.0:1788941042.874252:0:19659:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cac8433000: total 0 00010000:00010000:1.0:1788941042.874326:0:19659:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cac8433000, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1788941042.874365:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cbccee1a00) 00010000:00010000:1.0:1788941042.874369:0:19659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788941042.874378:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a800/0x24b6539075b3e862 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801518fc expref: 10 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941042.874423:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cbfeb5da00) 00010000:00010000:1.0:1788941042.874426:0:19659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788941042.874431:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3e942 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c9408015193b expref: 9 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941042.874462:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cbccee1500) 00010000:00010000:1.0:1788941042.874464:0:19659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788941042.874469:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41200/0x24b6539075b3ea68 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c9408015199d expref: 8 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941042.874480:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cbccee1500) 00010000:00010000:1.0:1788941042.874483:0:19659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788941042.874486:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3eb25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801519dc expref: 7 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941042.874503:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cac6855f00) 00010000:00010000:1.0:1788941042.874506:0:19659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788941042.874509:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbd3a29200/0x24b6539075b3eac3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801519b2 expref: 6 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941042.874523:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cac6855000) 00010000:00010000:1.0:1788941042.874525:0:19659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941042.874528:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40600/0x24b6539075b3e87e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151903 expref: 5 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941042.874543:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac67a4800) 00010000:00010000:1.0:1788941042.874546:0:19659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788941042.874550:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1ec00/0x24b6539075b3e8bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151911 expref: 4 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941042.874561:0:19659:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cac8433000, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1788941042.874575:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941042.874582:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941042.874584:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941042.889637:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941042.889737:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075974912 00000100:00100000:0.0:1788941042.889750:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075974912 00000100:00100000:0.0:1788941042.889969:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:0.0:1788941042.889981:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+5:2402:x1875840075974912:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:0.0:1788941042.890327:0:17124:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e79e 00000100:00080000:0.0:1788941042.890344:0:17124:0:(import.c:65:import_set_state_nolock()) ffff99cac8437800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788941042.890373:0:17124:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788941042.891245:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941042.891957:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac24e1ff-e60c-4c44-9273-4a80f445e0f5+3:2402:x1875840075974912:12345-192.168.201.42@tcp:39:umount.0 Request processed in 1971us (2324us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788941042.891970:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00010000:00010000:3.0:1788941043.077614:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941044.099993:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941044.616522:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102268928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788941044.616609:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941044.616731:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102268928 00000100:00100000:1.0:1788941044.616743:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102268928 00000100:00100000:1.0:1788941044.616823:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788941044.616864:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102268928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788941044.616894:0:18631:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788941044.616978:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941044.621596:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102268928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4752us (4974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941044.621611:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788941044.626533:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102268928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788941045.125585:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941045.636778:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941045.636803:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102269056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788941045.636897:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941045.637067:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102269056 00000100:00100000:0.0:1788941045.637075:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102269056 00000100:00100000:0.0:1788941045.637138:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788941045.637148:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102269056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788941045.637172:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941045.637216:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102269056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941045.637224:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788941045.637293:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941045.637330:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102269056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941045.842038:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941045.842076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941045.842377:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075975040 00000100:00100000:2.0:1788941045.842387:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075975040 00000100:00100000:2.0:1788941045.842450:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075975168 00000100:00100000:2.0:1788941045.842454:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075975168 00000100:00100000:2.0:1788941045.842476:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788941045.842486:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+11:2405:x1875840075975040:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941045.842502:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941045.842522:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f41600/0x24b6539075b3e7c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c9408015187e expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941045.842539:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941045.842594:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+10:2405:x1875840075975040:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 109us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941045.842614:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788941045.842632:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788941045.842649:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+9:2404:x1875840075975168:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941045.842658:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941045.842666:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f40400/0x24b6539075b3e7c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801518af expref: 9 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941045.842675:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941045.842693:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bf8ad97-92cf-4c14-8397-59cb869a8be2+8:2404:x1875840075975168:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 55us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941045.842700:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788941045.843005:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941045.843038:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075975296 00000100:00100000:0.0:1788941045.843044:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075975296 00000100:00100000:0.0:1788941045.843071:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788941045.843079:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bf8ad97-92cf-4c14-8397-59cb869a8be2+8:2404:x1875840075975296:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788941045.843086:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941045.843095:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3e83f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801518ee expref: 8 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941045.843105:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941045.843123:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bf8ad97-92cf-4c14-8397-59cb869a8be2+7:2404:x1875840075975296:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 45us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941045.843130:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788941045.861201:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941045.862794:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075975552 00000100:00100000:3.0:1788941045.862809:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075975552 00000100:00100000:3.0:1788941045.862930:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:3.0:1788941045.862941:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+6:2402:x1875840075975552:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:3.0:1788941045.862985:0:17122:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e7d6 00000020:00010000:3.0:1788941045.862995:0:17122:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cc01ac8800: total 0 00000100:00080000:3.0:1788941045.862999:0:17122:0:(import.c:65:import_set_state_nolock()) ffff99cbf93c9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788941045.863028:0:17122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:3.0:1788941045.863175:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+5:2402:x1875840075975552:12345-192.168.201.42@tcp:39:umount.0 Request processed in 235us (1983us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788941045.863182:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00080000:1.0:1788941045.863878:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788941045.864956:0:17111:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cc01ac8800: total 0 00010000:00010000:0.0:1788941045.865022:0:17111:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cc01ac8800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788941045.865060:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac67a4800) 00010000:00010000:0.0:1788941045.865064:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788941045.865075:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41a00/0x24b6539075b3e8cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151918 expref: 4 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941045.865099:0:17111:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cc01ac8800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788941045.865109:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941045.865111:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941045.865112:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941045.876904:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941045.877003:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075975680 00000100:00100000:2.0:1788941045.877013:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075975680 00000100:00100000:2.0:1788941045.877082:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:2.0:1788941045.877093:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+5:2402:x1875840075975680:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:2.0:1788941045.877133:0:18886:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e7dd 00000100:00080000:2.0:1788941045.877146:0:18886:0:(import.c:65:import_set_state_nolock()) ffff99cbe5773000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788941045.877209:0:18886:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788941045.877381:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a77bf5ab-277e-4ce0-a8d9-86d9926c3288+3:2402:x1875840075975680:12345-192.168.201.42@tcp:39:umount.0 Request processed in 290us (487us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788941045.877390:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00010000:00010000:3.0:1788941045.877942:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788941045.878684:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788941045.928275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941045.928547:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075975936 00000100:00100000:2.0:1788941045.928565:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075975936 00000100:00100000:2.0:1788941045.928646:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:2.0:1788941045.928658:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac192ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bf8ad97-92cf-4c14-8397-59cb869a8be2+7:2402:x1875840075975936:12345-192.168.201.42@tcp:251:umount.0 00000020:00000080:2.0:1788941045.928746:0:17117:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e774 00000020:00010000:2.0:1788941045.928755:0:17117:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cac66b9000: total 0 00000100:00080000:2.0:1788941045.928761:0:17117:0:(import.c:65:import_set_state_nolock()) ffff99cbfd893000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788941045.928902:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac192ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bf8ad97-92cf-4c14-8397-59cb869a8be2+3:2402:x1875840075975936:12345-192.168.201.42@tcp:251:umount.0 Request processed in 245us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941045.928912:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 176 00000020:00010000:3.0:1788941045.929414:0:17110:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cac66b9000: total 0 00010000:00010000:3.0:1788941045.929420:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941045.929583:0:17110:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cac66b9000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788941045.929636:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc0031a00/0x24b6539075b3e77b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151807 expref: 2 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941045.929654:0:17110:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cac66b9000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788941045.929666:0:17110:0:(genops.c:885:class_export_put()) final put ffff99cac66b9000/6bf8ad97-92cf-4c14-8397-59cb869a8be2 00010000:00010000:3.0:1788941045.929693:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941045.929696:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941045.929698:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788941045.931060:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac66b9000/6bf8ad97-92cf-4c14-8397-59cb869a8be2 for MGS 00000020:00000080:2.0:1788941045.931161:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfd893000 for MGS 00000100:00100000:0.0:1788941046.148785:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac19f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102269184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941046.149405:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788941046.149703:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941046.149828:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac19f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102269312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941046.153450:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941046.173688:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102269184 00000100:00100000:2.0:1788941046.173717:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102269184 00000100:00100000:2.0:1788941046.173829:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102269312 00000100:00100000:2.0:1788941046.173852:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102269312 00000100:00100000:2.0:1788941046.173880:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788941046.173892:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102269184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788941046.173953:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788941046.174451:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788941046.174467:0:19458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102269312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788941046.174492:0:19458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941046.174559:0:19458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102269312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (21121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941046.174567:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788941046.174637:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac19f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102269312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941046.175116:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102269184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1224us (25711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941046.175125:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788941046.182740:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac19f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102269184:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788941046.276813:0:17876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941047.173053:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941047.684227:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102269440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941047.684346:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.684438:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788941047.684446:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102269568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788941047.684474:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.684520:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102269440 00000100:00100000:3.0:1788941047.684532:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102269440 00000100:00100000:3.0:1788941047.684602:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102269568 00000100:00100000:3.0:1788941047.684606:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102269568 00000100:00100000:3.0:1788941047.684645:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788941047.684657:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102269440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788941047.684700:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788941047.684751:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102269440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941047.684758:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788941047.684779:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788941047.684786:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102269568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788941047.684796:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788941047.684819:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102269568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941047.684824:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788941047.684880:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788941047.684946:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102269568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788941047.684962:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102269440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941047.690879:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102269696:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692106:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692172:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102270208:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692205:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692230:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875840102270720:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692258:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692291:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788941047.692307:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102269824:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692363:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102270336:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692389:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692408:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875840102270848:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692429:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692472:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102269952:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692497:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692517:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875840102270464:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692537:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692556:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875840102270976:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.692576:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.692600:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788941047.692606:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102270080:0@lo:400:kworker.0 00000100:00100000:0.0:1788941047.693089:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102270720 00000100:00100000:0.0:1788941047.693101:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102270720 00000100:00100000:0.0:1788941047.693167:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102270848 00000100:00100000:0.0:1788941047.693171:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102270848 00000100:00100000:0.0:1788941047.693186:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102270464 00000100:00100000:0.0:1788941047.693189:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102270464 00000100:00100000:0.0:1788941047.693204:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102270976 00000100:00100000:0.0:1788941047.693207:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102270976 00000100:00100000:0.0:1788941047.693243:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788941047.693253:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875840102270720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941047.694015:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875840102270720:12345-0@lo:400:kworker.0 Request processed in 757us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941047.694025:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788941047.694056:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788941047.694066:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875840102270848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941047.694105:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875840102270848:12345-0@lo:400:kworker.0 Request processed in 43us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941047.694111:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788941047.694122:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788941047.694128:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875840102270464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941047.694157:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875840102270464:12345-0@lo:400:kworker.0 Request processed in 29us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941047.694162:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788941047.694173:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788941047.694178:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875840102270976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941047.694205:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875840102270976:12345-0@lo:400:kworker.0 Request processed in 27us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941047.694211:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788941047.695380:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.695457:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102270592:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.695513:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941047.695554:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875840102270464:0@lo:400:kworker.0 00010000:00080000:3.0:1788941047.695571:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe572c000 x1875840102270976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941047.695584:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875840102270976:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.695642:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102270208 00000100:00100000:3.0:1788941047.695651:0:19458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102270208 00000100:00100000:3.0:1788941047.695703:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102269824 00000100:00100000:3.0:1788941047.695706:0:19458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102269824 00000100:00100000:3.0:1788941047.695722:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788941047.695729:0:19458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102270208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.695784:0:19458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102270208:12345-0@lo:400:kworker.0 Request processed in 54us (3577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941047.695791:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788941047.695807:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788941047.695813:0:19458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102269824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.695862:0:19458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102269824:12345-0@lo:400:kworker.0 Request processed in 50us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941047.695869:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788941047.695887:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102270080 00000100:00100000:3.0:1788941047.695891:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102270080 00000100:00100000:3.0:1788941047.695909:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102270592 00000100:00100000:3.0:1788941047.695911:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102270592 00000100:00100000:3.0:1788941047.695927:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788941047.695933:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102270080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.695977:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102270080:12345-0@lo:400:kworker.0 Request processed in 44us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941047.695984:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788941047.695996:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788941047.696002:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875840102270592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696028:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875840102270592:12345-0@lo:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941047.696033:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788941047.696054:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102270336 00000100:00100000:3.0:1788941047.696058:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102270336 00000100:00100000:3.0:1788941047.696092:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102269952 00000100:00100000:3.0:1788941047.696095:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102269952 00000100:00100000:3.0:1788941047.696115:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788941047.696121:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102270336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696155:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102270336:12345-0@lo:400:kworker.0 Request processed in 34us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941047.696161:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788941047.696172:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788941047.696178:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102269952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696209:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102269952:12345-0@lo:400:kworker.0 Request processed in 32us (3711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941047.696215:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788941047.696232:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788941047.696238:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941047.696240:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788941047.696267:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102269824:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696294:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102270336:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696323:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875840102270848:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102270208:0@lo:400:kworker.0 00010000:00080000:3.0:1788941047.696348:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe572f800 x1875840102270720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941047.696358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875840102270720:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696402:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102270080:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696413:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102270592:0@lo:400:kworker.0 00000100:00100000:3.0:1788941047.696423:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102269952:0@lo:400:kworker.0 00000100:00100000:1.0:1788941047.698828:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102269696 00000100:00100000:1.0:1788941047.698872:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102269696 00000100:00100000:1.0:1788941047.698981:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788941047.698994:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac192fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+24:3649:x1875840102269696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941047.699125:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac192fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+24:3649:x1875840102269696:12345-0@lo:400:kworker.0 Request processed in 134us (7022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941047.699134:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788941047.699362:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102269696:0@lo:400:kworker.0 00010000:00010000:1.0:1788941048.198801:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788941048.207133:0:19443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac24e1ff-e60c-4c44-9273-4a80f445e0f5 00000020:00000080:0.0:1788941048.207141:0:19443:0:(genops.c:885:class_export_put()) final put ffff99cac5a70000/ac24e1ff-e60c-4c44-9273-4a80f445e0f5 00000001:00100000:1.0:1788941048.207217:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a77bf5ab-277e-4ce0-a8d9-86d9926c3288 00000001:00080000:1.0:1788941048.207231:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1788941048.207234:0:17102:0:(genops.c:885:class_export_put()) final put ffff99cc01ac8800/a77bf5ab-277e-4ce0-a8d9-86d9926c3288 00000001:00100000:1.0:1788941048.207239:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ac24e1ff-e60c-4c44-9273-4a80f445e0f5 00000001:00080000:1.0:1788941048.207241:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:1.0:1788941048.207243:0:17102:0:(genops.c:885:class_export_put()) final put ffff99cac8433000/ac24e1ff-e60c-4c44-9273-4a80f445e0f5 00000020:00000080:2.0:1788941048.207464:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac5a70000/ac24e1ff-e60c-4c44-9273-4a80f445e0f5 for lustre-OST0001 00000001:00100000:0.0:1788941048.207606:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a77bf5ab-277e-4ce0-a8d9-86d9926c3288 00000001:00080000:0.0:1788941048.207611:0:17856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788941048.207613:0:17856:0:(genops.c:885:class_export_put()) final put ffff99cbe5770000/a77bf5ab-277e-4ce0-a8d9-86d9926c3288 00000020:00000080:2.0:1788941048.210163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01ac8800/a77bf5ab-277e-4ce0-a8d9-86d9926c3288 for lustre-MDT0000 00000020:00000080:2.0:1788941048.210243:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac8433000/ac24e1ff-e60c-4c44-9273-4a80f445e0f5 for lustre-MDT0000 00000020:00000080:2.0:1788941048.210268:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac78fb800 for lustre-OST0001 00000020:00000080:2.0:1788941048.210273:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbf93c9800 for lustre-MDT0000 00000020:00000080:2.0:1788941048.210277:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac8431000 for lustre-MDT0000 00000001:00100000:0.0:1788941048.218908:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ac24e1ff-e60c-4c44-9273-4a80f445e0f5 00000001:00080000:0.0:1788941048.218926:0:17856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788941048.218933:0:17856:0:(genops.c:885:class_export_put()) final put ffff99cac8435000/ac24e1ff-e60c-4c44-9273-4a80f445e0f5 00000020:00000080:2.0:1788941048.219214:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbe5770000/a77bf5ab-277e-4ce0-a8d9-86d9926c3288 for lustre-MDT0001 00000020:00000080:2.0:1788941048.219281:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac8435000/ac24e1ff-e60c-4c44-9273-4a80f445e0f5 for lustre-MDT0001 00000020:00000080:2.0:1788941048.219332:0:2722:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbe5773000 for lustre-MDT0001 00000020:00000080:2.0:1788941048.219337:0:2722:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac8437800 for lustre-MDT0001 00000020:01000004:1.0:1788941048.506047:0:20695:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788941048.513229:0:20695:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788941048.513295:0:20695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941048.513310:0:20695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941048.513317:0:20695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941048.513324:0:20695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941048.514041:0:20695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788941048.514050:0:20695:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788941048.514216:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788941048.514222:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788941048.514230:0:20695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788941048.514258:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cbfed2e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788941048.514327:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875840102271104:0@lo:39:umount.0 00000100:00100000:0.0:1788941048.514420:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941048.514582:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941048.514593:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.514603:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5400 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941048.514606:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.514616:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941048.514623:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941048.514629:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788941048.514648:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788941048.514651:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788941048.514686:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.514693:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941048.514719:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.514726:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5400/0x24b6539075b3e337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e33e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.514741:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941048.514743:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941048.514744:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941048.514762:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788941048.514775:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3651:1875840102271232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941048.514812:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941048.515042:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102271104 00000100:00100000:0.0:1788941048.515051:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102271104 00000100:00100000:0.0:1788941048.515215:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788941048.515229:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875840102271104:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788941048.515260:0:17122:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e368 00000100:00080000:0.0:1788941048.515268:0:17122:0:(import.c:65:import_set_state_nolock()) ffff99cbf6b87000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788941048.515353:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3648:x1875840102271104:12345-0@lo:39:umount.0 Request processed in 126us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941048.515362:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:0.0:1788941048.515386:0:17122:0:(genops.c:885:class_export_put()) final put ffff99cbfed29800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788941048.515441:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941048.515574:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102271232 00000100:00100000:0.0:1788941048.515579:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102271232 00000100:00100000:0.0:1788941048.515651:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788941048.515659:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbdddd5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+24:3651:x1875840102271232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941048.515671:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941048.515688:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbd3a29400/0x24b6539075b3e33e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e337 expref: 24 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941048.515701:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941048.515740:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbdddd5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+23:3651:x1875840102271232:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941048.515746:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788941048.515873:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3651:1875840102271232:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788941048.517927:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfed29800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788941048.518228:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbf6b87000 for lustre-MDT0000 00000100:00080000:0.0:1788941048.518294:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfed2e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788941048.518349:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875840102271104:0@lo:39:umount.0 00000100:00080000:1.0:1788941048.518397:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788941048.518402:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788941048.518408:0:20695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788941048.519742:0:20695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.519973:0:20695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.519983:0:20695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.519990:0:20695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520142:0:20695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941048.520151:0:20695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520158:0:20695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520165:0:20695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520171:0:20695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520196:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941048.520204:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520212:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4800 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941048.520216:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520224:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941048.520240:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941048.520246:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788941048.520248:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788941048.520281:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520299:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788941048.520352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102271360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788941048.520428:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941048.520545:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520554:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4800/0x24b6539075b3e288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e28f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520570:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941048.520573:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520579:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cc021e6a00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941048.520582:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520589:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941048.520595:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941048.520599:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788941048.520608:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788941048.520622:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.520628:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941048.520658:0:20695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1788941048.520663:0:20695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788941048.520672:0:20695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520680:0:20695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520686:0:20695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520693:0:20695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520708:0:20695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941048.520724:0:19659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941048.520728:0:19659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520734:0:19659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc0031c00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941048.520737:0:19659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520744:0:19659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941048.520751:0:19659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941048.520767:0:19659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788941048.520769:0:19659:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788941048.520771:0:19659:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788941048.520785:0:19659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520791:0:19659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941048.520807:0:19659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520814:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbc0031c00/0x24b6539075b3e831 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e838 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520825:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941048.520827:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941048.520829:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941048.520857:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788941048.520869:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102271616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941048.520905:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788941048.520940:0:20695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520948:0:20695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520954:0:20695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520961:0:20695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.520973:0:20695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788941048.520976:0:20695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788941048.520979:0:20695:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788941048.521016:0:19659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941048.521021:0:19659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.521027:0:19659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4000 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941048.521030:0:19659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.521036:0:19659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941048.521042:0:19659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941048.521059:0:19659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788941048.521248:0:19659:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788941048.521250:0:19659:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788941048.521267:0:19659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.521274:0:19659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941048.521295:0:19659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.521302:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4000/0x24b6539075b3e27a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e281 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.521312:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941048.521314:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941048.521316:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941048.521330:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102271744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941048.521361:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941048.521397:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102271360 00000100:00100000:1.0:1788941048.521405:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102271360 00000100:00100000:1.0:1788941048.521522:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102271616 00000100:00100000:1.0:1788941048.521525:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102271616 00000100:00100000:1.0:1788941048.521539:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102271744 00000100:00100000:1.0:1788941048.521542:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102271744 00000100:00100000:1.0:1788941048.521557:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941048.521565:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+25:3649:x1875840102271360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941048.521581:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941048.521597:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec5a00/0x24b6539075b3e28f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e288 expref: 25 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941048.521620:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788941048.521885:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.521893:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cc021e6a00/0x24b6539075b3e69b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e6a2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.521905:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941048.521906:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941048.521908:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941048.521923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3650:1875840102271488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941048.521954:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941048.521985:0:20151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102271488 00000100:00100000:3.0:1788941048.521989:0:20151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102271488 00000100:00100000:3.0:1788941048.522014:0:20151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788941048.522021:0:20151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+25:3652:x1875840102271616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941048.522029:0:20151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941048.522038:0:20151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfeb1ea00/0x24b6539075b3e838 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e831 expref: 25 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.522049:0:20151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941048.522153:0:20151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+24:3652:x1875840102271616:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941048.522161:0:20151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788941048.522180:0:20151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788941048.522186:0:20151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+23:3652:x1875840102271744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941048.522204:0:20151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941048.522213:0:20151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbd3a28400/0x24b6539075b3e281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e27a expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.522222:0:20151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941048.522243:0:20151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+22:3652:x1875840102271744:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941048.522249:0:20151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788941048.522262:0:20151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788941048.522268:0:20151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+21:3650:x1875840102271488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941048.522274:0:20151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941048.522282:0:20151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3e6a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e69b expref: 21 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941048.522302:0:20151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941048.522326:0:20151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+20:3650:x1875840102271488:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941048.522332:0:20151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788941048.522364:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3650:1875840102271488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941048.522405:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102271744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941048.522566:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102271616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941048.522591:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941048.522687:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+19:3649:x1875840102271360:12345-0@lo:103:ldlm_bl.0 Request processed in 1122us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941048.522695:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000020:01000004:1.0:1788941048.522725:0:20695:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788941048.522731:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788941048.522737:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788941048.522743:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1788941048.522748:0:20695:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbfd893800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788941048.522818:0:20695:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99cac6802000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788941048.522823:0:20695:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbc91d7000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788941048.522827:0:20695:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99cc01abb800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788941048.522859:0:20695:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99cbfecbb380) has exports, disconnecting them 00000020:00080000:1.0:1788941048.522865:0:20695:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cbfd893800), last request at 1788941047 00000020:00000080:1.0:1788941048.522872:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e66a 00000100:00080000:1.0:1788941048.522889:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cbfd896000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788941048.522944:0:20695:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbfd893800): rc 0 00000020:00000080:1.0:1788941048.522947:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfd893800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788941048.522960:0:20695:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cac6802000), last request at 1788941047 00000020:00000080:1.0:1788941048.522964:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e50c 00000100:00080000:1.0:1788941048.522972:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cac6803800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788941048.522984:0:20695:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cac6802000): rc 0 00000020:00000080:1.0:1788941048.522986:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cac6802000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788941048.522991:0:20695:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cbc91d7000), last request at 1788940964 00000020:00000080:1.0:1788941048.522994:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e456 00000100:00080000:1.0:1788941048.522997:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cbc91d2000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788941048.523017:0:20695:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbc91d7000): rc 0 00000020:00000080:1.0:1788941048.523019:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbc91d7000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788941048.523023:0:20695:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cc01abb800), last request at 1788940964 00000020:00000080:1.0:1788941048.523027:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e3fb 00000100:00080000:1.0:1788941048.523030:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cc01abd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788941048.523036:0:20695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:1.0:1788941048.523211:0:20695:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cc01abb800): rc 0 00000004:00000080:1.0:1788941048.523219:0:20695:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1f20145bae0 00000100:00080000:1.0:1788941048.523245:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788941048.523249:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788941048.525038:0:20695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788941048.525511:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cbfd8d8000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788941048.525665:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102271360:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788941048.525719:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfd893800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788941048.526250:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac6802000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1788941048.526348:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102271872:0@lo:39:umount.0 00000100:00100000:2.0:1788941048.526523:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941048.527996:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102271872 00000100:00100000:3.0:1788941048.528008:0:19458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102271872 00000100:00100000:3.0:1788941048.528134:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788941048.528147:0:19458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac19fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875840102271872:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788941048.528194:0:19458:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e480 00000100:00080000:3.0:1788941048.528205:0:19458:0:(import.c:65:import_set_state_nolock()) ffff99cbc4670000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788941048.528223:0:19458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788941048.528549:0:19458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac19fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3648:x1875840102271872:12345-0@lo:39:umount.0 Request processed in 404us (2026us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788941048.528557:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:3.0:1788941048.528598:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941048.528605:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788941048.528640:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfd8d8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788941048.528649:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102271872:0@lo:39:umount.0 00010000:00010000:3.0:1788941048.528665:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788941048.529047:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788941048.529052:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788941048.529292:0:20695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788941048.529355:0:20695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788941048.529378:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cbfd8d9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788941048.529395:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788941048.529398:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788941048.529407:0:20695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788941048.529533:0:20695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788941048.529544:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cbfd8d9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788941048.529588:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99cbfecbb380) has no exports 00000100:00100000:3.0:1788941048.529687:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102272000:0@lo:9:umount.0 00000100:00100000:3.0:1788941048.529742:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941048.529782:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102272128:0@lo:9:umount.0 00000100:00100000:3.0:1788941048.529800:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941048.529851:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102272000 00000100:00100000:3.0:1788941048.529857:0:19043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102272000 00000100:00100000:3.0:1788941048.529889:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102272128 00000100:00100000:3.0:1788941048.529891:0:19043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102272128 00000100:00100000:3.0:1788941048.529909:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788941048.529917:0:19043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875840102272000:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788941048.529937:0:19043:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e54b 00000100:00080000:3.0:1788941048.529944:0:19043:0:(import.c:65:import_set_state_nolock()) ffff99cbfd894000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788941048.529981:0:19043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788941048.530222:0:19043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3648:x1875840102272000:12345-0@lo:9:umount.0 Request processed in 304us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941048.530229:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788941048.530255:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788941048.530261:0:19043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875840102272128:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788941048.530272:0:19043:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e6a9 00000100:00080000:3.0:1788941048.530277:0:19043:0:(import.c:65:import_set_state_nolock()) ffff99cac66bc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788941048.530309:0:19043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788941048.530379:0:19043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3648:x1875840102272128:12345-0@lo:9:umount.0 Request processed in 117us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941048.530385:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1788941048.530409:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941048.530486:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788941048.530512:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfd8d9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1788941048.530600:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc91d7000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788941048.530640:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfd896000 for lustre-MDT0000 00000020:00000080:0.0:1788941048.530645:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac6803800 for lustre-MDT0000 00000020:00000080:0.0:1788941048.530649:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbc91d2000 for lustre-MDT0000 00000004:00080000:3.0:1788941048.534690:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788941048.534698:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788941048.534707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102272000:0@lo:9:umount.0 00000100:00080000:3.0:1788941048.535132:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfd8d9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788941048.535176:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788941048.535275:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788941048.535280:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102272128:0@lo:9:umount.0 00000020:00080000:1.0:1788941048.544568:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99cbfecbb380) has no exports 00000020:00000080:1.0:1788941048.596235:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2d5 00000020:00000080:1.0:1788941048.596252:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbca6ae000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788941048.596317:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788941048.596368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbca6ae000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788941048.596396:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788941048.596406:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788941048.596517:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99cac7aa19c0) has no exports 00000020:00000080:0.0:1788941048.597167:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2ce 00000020:00000080:0.0:1788941048.597175:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfdb77800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788941048.597264:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfdb77800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788941048.597334:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788941048.597344:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788941048.597347:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfda46000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788941048.597349:0:20695:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfda46000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788941048.597354:0:20695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788941049.220938:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941050.245133:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941050.756135:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102272256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788941050.756230:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941050.756348:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102272256 00000100:00100000:0.0:1788941050.756358:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102272256 00000100:00100000:0.0:1788941050.756432:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788941050.756442:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102272256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788941050.756472:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941050.756517:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102272256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941050.756524:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788941050.756680:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941050.756790:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102272256:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788941051.269508:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941051.269963:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac19f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102272384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941051.270039:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941051.270576:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102272384 00000100:00100000:2.0:1788941051.270586:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102272384 00000100:00100000:2.0:1788941051.270644:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788941051.270653:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875840102272384:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788941051.270662:0:17127:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788941051.270733:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875840102272384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (693us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788941051.270740:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:02020000:0.0:1788941051.270900:0:3650:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788941051.276229:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788941051.280453:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99cc01a03800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788941051.280469:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788941051.288467:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99cc01a03800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788941051.288484:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 572 00000100:00080000:0.0:1788941051.288502:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cc01a03800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788941051.288551:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfeb95180 x1875840102272512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788941051.288798:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102272512:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788941051.288901:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941051.292602:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102272512 00000100:00100000:0.0:1788941051.292622:0:19458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102272512 00000100:00100000:0.0:1788941051.292680:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788941051.292688:0:19458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875840102272512:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788941051.292707:0:19458:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788941051.309412:0:19458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875840102272512:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 16711us (20498us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788941051.309431:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788941051.310101:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01a03800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788941051.310110:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788941051.310115:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102272512:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1788941052.295295:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941052.804181:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102272640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788941052.804262:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941052.804324:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102272640 00000100:00100000:0.0:1788941052.804333:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102272640 00000100:00100000:0.0:1788941052.804397:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788941052.804408:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102272640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788941052.804440:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788941052.804486:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102272640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941052.804493:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788941052.804553:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788941052.804643:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102272640:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788941052.804693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941052.804699:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788941052.804703:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cc01a03800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941052.804708:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:1.0:1788941052.804712:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788941052.804720:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cc01a03800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941052.804742:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8596a00 x1875840102272896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941052.804822:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102273024:0@lo:400:kworker.0 00000100:00100000:1.0:1788941052.804879:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941052.804900:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875840102273536:0@lo:400:kworker.0 00000100:00100000:1.0:1788941052.804924:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941052.804943:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788941052.804949:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102273152:0@lo:400:kworker.0 00000100:00100000:1.0:1788941052.804971:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941052.804987:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102273664:0@lo:400:kworker.0 00000100:00100000:1.0:1788941052.805009:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941052.805035:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102273536 00000100:00100000:1.0:1788941052.805040:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102273536 00000100:00100000:1.0:1788941052.805063:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102273152 00000100:00100000:1.0:1788941052.805066:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102273152 00000100:00100000:1.0:1788941052.805075:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102273664 00000100:00100000:1.0:1788941052.805091:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102273664 00000100:00100000:1.0:1788941052.805130:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788941052.805140:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875840102273664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941052.805149:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102273024 00000100:00100000:3.0:1788941052.805155:0:19043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102273024 00000100:00100000:3.0:1788941052.805188:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788941052.805197:0:19043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102273024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941052.805203:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875840102273664:12345-0@lo:400:kworker.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941052.805223:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788941052.805243:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788941052.805248:0:19043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102273024:12345-0@lo:400:kworker.0 Request processed in 51us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941052.805251:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875840102273536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941052.805260:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000020:00080000:1.0:1788941052.805262:0:17124:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788941052.805287:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788941052.805293:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875840102273152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941052.805299:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875840102273536:12345-0@lo:400:kworker.0 Request processed in 46us (371us total) trans 0 rc -107/-107 00000020:00080000:3.0:1788941052.805303:0:17123:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788941052.805312:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1788941052.805346:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac8597800 x1875840102273664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941052.805356:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102273664:0@lo:400:kworker.0 00000100:00100000:1.0:1788941052.805367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102273024:0@lo:400:kworker.0 00000100:00080000:1.0:1788941052.805375:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788941052.805380:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99cac6624000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788941052.805384:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788941052.805388:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99cac6624000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941052.805391:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 609 00000100:00100000:0.0:1788941052.805464:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102272896:0@lo:38:kworker.0 00000100:00100000:2.0:1788941052.805515:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102272768:0@lo:400:kworker.0 00000100:00080000:1.0:1788941052.805558:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cac6624000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941052.805574:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8596300 x1875840102273792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941052.805596:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875840102273536:0@lo:400:kworker.0 00000100:00100000:3.0:1788941052.814162:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875840102273152:12345-0@lo:400:kworker.0 Request processed in 8857us (9179us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788941052.814182:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788941052.814259:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102273280:0@lo:400:kworker.0 00000100:00080000:1.0:1788941052.814626:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788941052.814633:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788941052.814680:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788941052.814687:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99cbc4672800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788941052.814691:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788941052.814697:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99cbc4672800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941052.814702:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 572 00000100:00100000:3.0:1788941052.815001:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941052.815077:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102273280 00000100:00100000:3.0:1788941052.815086:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102273280 00000100:00100000:3.0:1788941052.815147:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788941052.815155:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1875840102273280:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788941052.815164:0:17124:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788941052.815220:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1875840102273280:12345-0@lo:400:kworker.0 Request processed in 54us (208us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788941052.815227:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788941052.815269:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788941052.815272:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99cbc9c65000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788941052.815275:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788941052.815279:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99cbc9c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941052.815283:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 589 00000100:00080000:3.0:1788941052.815293:0:3651:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc9c65000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941052.815348:0:3651:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe572f800 x1875840102273920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788941052.815369:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102273280:0@lo:400:kworker.0 00000100:00080000:1.0:1788941052.818249:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbc4672800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941052.818292:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8595880 x1875840102274048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941052.818313:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102273152:0@lo:400:kworker.0 00000100:00100000:0.0:1788941052.818957:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941052.819035:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875840102273792:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788941052.819076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941052.819110:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875840102273920:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788941052.819149:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941052.819171:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875840102274048:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788941052.819191:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941052.819470:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102272896 00000100:00100000:3.0:1788941052.819481:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102272896 00000100:00100000:3.0:1788941052.819527:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788941052.819534:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875840102272896:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788941052.819552:0:17128:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788941052.821947:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102273792 00000100:00100000:1.0:1788941052.821965:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102273792 00000100:00100000:1.0:1788941052.822018:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102273920 00000100:00100000:1.0:1788941052.822021:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102273920 00000100:00100000:1.0:1788941052.822029:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102274048 00000100:00100000:1.0:1788941052.822031:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102274048 00000100:00100000:1.0:1788941052.822044:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788941052.822050:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102273792:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788941052.822067:0:18886:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788941052.822463:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102273792:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 410us (3383us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788941052.822471:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788941052.822491:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788941052.822511:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102273920:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788941052.822519:0:18886:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788941052.822547:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102273920:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 36us (3397us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788941052.822552:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788941052.822564:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788941052.822569:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102274048:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788941052.822576:0:18886:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788941052.822598:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102274048:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 29us (3406us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788941052.822603:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788941052.824018:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac6624000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941052.824041:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788941052.824046:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875840102273792:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788941052.824059:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc9c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941052.824062:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788941052.824066:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875840102273920:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788941052.824075:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc4672800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941052.824078:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788941052.824080:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875840102274048:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788941052.827359:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941052.827429:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875840102273408:0@lo:400:kworker.0 00000100:00100000:2.0:1788941052.827477:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941052.827578:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102272768 00000100:00100000:0.0:1788941052.827587:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102272768 00000100:00100000:0.0:1788941052.827647:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788941052.827658:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac192f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+19:3652:x1875840102272768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941052.827720:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac192f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f+19:3652:x1875840102272768:12345-0@lo:400:kworker.0 Request processed in 64us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941052.827729:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788941052.827948:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102272768:0@lo:400:kworker.0 00000100:00080000:0.0:1788941052.839360:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01a03800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941052.839375:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788941052.839380:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102272896:0@lo:38:kworker.0 00000100:00100000:1.0:1788941052.840693:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102273408 00000100:00100000:1.0:1788941052.840705:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102273408 00000100:00100000:1.0:1788941052.840796:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788941052.840807:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac19f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875840102273408:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788941052.840900:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788941052.851994:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac19f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875840102273408:12345-0@lo:400:kworker.0 Request processed in 11177us (24503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941052.852014:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1788941052.852174:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac8595500 x1875840102273408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941052.852192:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875840102273408:0@lo:400:kworker.0 00000100:00100000:3.0:1788941052.854097:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875840102272896:12345-0@lo:38:kworker.0 Request processed in 34555us (35134us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788941052.854113:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1788941053.316387:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941054.340921:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788941054.345531:0:18624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788941054.345546:0:18624:0:(genops.c:885:class_export_put()) final put ffff99cbfd890000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788941054.346896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfd890000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788941054.346965:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfd894000 for lustre-OST0000 00000001:00100000:0.0:1788941054.347347:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788941054.347360:0:17856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788941054.347364:0:17856:0:(genops.c:885:class_export_put()) final put ffff99cbc4676800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788941054.347447:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc4676800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788941054.347511:0:2722:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbc4670000 for lustre-MDT0001 00000001:00100000:2.0:1788941054.348032:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788941054.348037:0:17102:0:(genops.c:885:class_export_put()) final put ffff99cc01abb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788941054.348189:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01abb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788941054.348225:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cc01abd800 for lustre-MDT0000 00000001:00100000:0.0:1788941054.354098:0:19443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788941054.354114:0:19443:0:(genops.c:885:class_export_put()) final put ffff99cac66bb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788941054.354645:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac66bb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788941054.354714:0:2722:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac66bc000 for lustre-OST0001 00000020:01000000:0.0:1788941054.659953:0:20695:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cbc8fba420 - data ffff99cac5c0c5e8/ffff99cac66a0c00 00000020:01000000:0.0:1788941054.660111:0:20695:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cbfe9e5f00 - data ffff99cbed8bb5e8/ffff99cbc6bf6400 00000001:00000004:0.0:1788941054.668240:0:20695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1788941054.730598:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788941054.730609:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788941054.730627:0:20695:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99cac7d48e00 x1875840102271872/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788941058 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941054.730654:0:20695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788941054.735620:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788941054.735631:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788941054.735713:0:20695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788941054.735716:0:20695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788941054.745662:0:17146:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788941054.745675:0:17146:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788941054.746208:0:17146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788941054.748260:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788941054.748269:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1788941054.748295:0:20695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788941054.748298:0:20695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788941054.749795:0:17148:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788941054.749803:0:17148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788941054.749823:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788941054.755599:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e29d 00000020:00000080:2.0:1788941054.755617:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cac5a75800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788941054.758338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac5a75800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788941054.763660:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2b2 00000020:00000080:2.0:1788941054.763678:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfd8db800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788941054.764953:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788941054.764968:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788941054.764980:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788941054.764985:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff99cbfecbcd40) has no exports 00000004:01000000:2.0:1788941054.765213:0:20695:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788941054.765223:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e314 00000020:00000080:2.0:1788941054.765230:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbf6b8b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788941054.775676:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfd8db800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788941054.778755:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788941054.778806:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788941054.778822:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788941054.778828:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff99cbcbcecd40) has no exports 00000020:00000080:1.0:1788941054.778999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b8b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788941054.779196:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e30d 00000020:00000080:2.0:1788941054.779217:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cac7944800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788941054.779398:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac7944800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788941054.780736:0:20695:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788941054.780744:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788941054.780749:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1788941054.780757:0:20695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788941054.780760:0:20695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788941054.780815:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788941054.780825:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788941054.780864:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2ff 00000020:00000080:2.0:1788941054.780873:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cac7946000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788941054.780879:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788941054.780885:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788941054.780890:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788941054.780893:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff99cbcbce8000) has no exports 00000020:00000080:2.0:1788941054.780902:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2f8 00000020:00000080:2.0:1788941054.780906:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfd8dd000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788941054.781086:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfd8d9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788941054.781094:0:36:0:(genops.c:885:class_export_put()) final put ffff99cac7943800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788941054.781097:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac7943800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788941054.781103:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788941054.781218:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac7946000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788941054.781223:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfd8dd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788941054.783026:0:20695:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788941054.783034:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788941054.783039:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1788941054.783045:0:20695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788941054.783047:0:20695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788941054.783266:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788941054.783276:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788941054.783292:0:20695:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788941054.783299:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2ea 00000020:00000080:2.0:1788941054.783308:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbc2d69800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788941054.783313:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788941054.783318:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788941054.783322:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788941054.783326:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff99cbfecb8000) has no exports 00000020:00000080:2.0:1788941054.783332:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2e3 00000020:00000080:2.0:1788941054.783335:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfd8dc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788941054.783699:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfd8d9000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788941054.783708:0:36:0:(genops.c:885:class_export_put()) final put ffff99cbc2d68800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788941054.783712:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc2d68800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788941054.783719:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788941054.783813:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc2d69800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788941054.783818:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfd8dc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788941054.789994:0:20695:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788941054.790004:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788941054.790009:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788941054.790018:0:20695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788941054.790086:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941054.790113:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788941054.790140:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941054.790143:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788941054.790148:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cac5a72000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788941054.790158:0:20695:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac5a72000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788941054.790209:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfd8d8000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788941054.790217:0:36:0:(genops.c:885:class_export_put()) final put ffff99cbfd8dc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788941054.790219:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfd8dc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788941054.790230:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788941054.790421:0:20695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788941054.790502:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2b9 00000020:00000080:3.0:1788941054.790511:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfd8d8800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788941054.790527:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788941054.790533:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788941054.790538:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788941054.790543:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff99cbfecb99c0) has no exports 00000020:00000080:3.0:1788941054.790563:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941054.790566:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788941054.790571:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e2c0 00000020:00000080:3.0:1788941054.790574:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfd8dd800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788941054.790585:0:20695:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cac8897000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788941054.790588:0:20695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cac8897000 3 00000020:01000004:3.0:1788941054.790592:0:20695:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cac8897000 from lustre-MDT0000 00000020:00000080:3.0:1788941054.790615:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941054.790619:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788941054.790622:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cac5a74800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788941054.790624:0:20695:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac5a74800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788941054.790631:0:20695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788941054.790670:0:20695:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788941054.790674:0:20695:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788941054.790677:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788941054.790679:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788941054.790682:0:20695:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788941054.790700:0:20695:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff99cbfda44800 a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788941054.790706:0:20695:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff99cbfdb68000) has exports, disconnecting them 00000020:00080000:3.0:1788941054.790710:0:20695:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99cbfda44800), last request at 1788940947 00000020:00000080:3.0:1788941054.790734:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e265 00000020:00010000:3.0:1788941054.790738:0:20695:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cbfda44800: total 2 00000100:00080000:3.0:1788941054.790742:0:20695:0:(import.c:65:import_set_state_nolock()) ffff99cbfda47800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788941054.790758:0:20695:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbfda44800): rc 0 00000020:00080000:3.0:1788941054.790762:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff99cbfdb68000) has no exports 00000100:00100000:3.0:1788941054.790818:0:17116:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff99cbfede1200:17116] 1 exiting: rc = 0 00000020:00000080:1.0:1788941054.790908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfd8d8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788941054.790913:0:36:0:(genops.c:885:class_export_put()) final put ffff99cac5a73000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788941054.790914:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac5a73000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788941054.790918:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788941054.790952:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfd8dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788941054.790984:0:17114:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff99cbfede0a00:17114] 0 exiting: rc = 1 00000020:00010000:3.0:1788941054.793108:0:17110:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cbfda44800: total 0 00010000:00010000:3.0:1788941054.793191:0:17110:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cbfda44800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788941054.793229:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfeb1f600/0x24b6539075b3e62b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e624 expref: 14 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793249:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfeb1f800/0x24b6539075b3e392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e38b expref: 13 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793265:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc0030400/0x24b6539075b3e82a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e823 expref: 12 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793276:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec4600/0x24b6539075b3e3a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e399 expref: 11 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793286:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbd3a29a00/0x24b6539075b3e273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e26c expref: 10 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793296:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3e4f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e4e9 expref: 9 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793306:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc0030a00/0x24b6539075b3e81c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e815 expref: 8 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793315:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbd3a28600/0x24b6539075b3e441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e43a expref: 7 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793350:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec5800/0x24b6539075b3e655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e64e expref: 6 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793361:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cc021e6200/0x24b6539075b3e694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e68d expref: 5 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793374:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfeb1fa00/0x24b6539075b3e4c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e4bf expref: 4 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793387:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f41e00/0x24b6539075b3e80e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e807 expref: 3 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793399:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfeb1f000/0x24b6539075b3e384 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b6539075b3e37d expref: 2 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.793409:0:17110:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cbfda44800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788941054.793425:0:17110:0:(genops.c:885:class_export_put()) final put ffff99cbfda44800/a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f 00010000:00010000:3.0:1788941054.793445:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941054.793447:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941054.793449:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788941054.793540:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfda44800/a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f for MGS 00000020:00000080:1.0:1788941054.793583:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfda47800 for MGS 00000100:00100000:3.0:1788941054.795642:0:17117:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff99cbfede1c00:17117] 2 exiting: rc = 0 00000100:00100000:1.0:1788941054.796021:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796030:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796037:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796044:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796053:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796058:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796064:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796070:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796094:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796101:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796108:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796113:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796118:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796122:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796127:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796132:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796137:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796144:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796151:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796157:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796162:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796168:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796184:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796190:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796196:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796202:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796207:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796213:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796219:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796224:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796229:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796236:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796242:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796265:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796271:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796277:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796283:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796289:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796294:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796300:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796306:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796311:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796318:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796323:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796329:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796335:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796341:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796348:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796353:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796358:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796364:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796370:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796375:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796382:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796388:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796393:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796399:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796405:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796411:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796416:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796423:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796428:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796434:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941054.796439:0:20695:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788941054.843787:0:20695:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cbc28c89c0 - data ffff99cac5c09948/ffff99cbe5788800 00000020:01000000:1.0:1788941054.843950:0:20695:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cac852eae0 - data ffff99cbed9bd510/ffff99cbc4d23c00 00000020:00000080:1.0:1788941054.844373:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e249 00000020:00000080:1.0:1788941054.844392:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbcb907000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788941054.844407:0:20695:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cac8897000 from MGS, refs=2 00000020:01000004:1.0:1788941054.844410:0:20695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cac8897000 2 00000020:01000004:1.0:1788941054.844413:0:20695:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cac8897000 from MGS 00000020:00000080:1.0:1788941054.844433:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788941054.844440:0:20695:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788941054.844443:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbcb904800/MGS 00000020:00000080:1.0:1788941054.844446:0:20695:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbcb904800/MGS for MGS 00000020:01000000:1.0:1788941054.844453:0:20695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788941054.844519:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788941054.844523:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788941054.844527:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788941054.844534:0:20695:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99cbfed2d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788941054.844541:0:20695:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff99cbfd80b380) has exports, disconnecting them 00000020:00080000:1.0:1788941054.844546:0:20695:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99cbfed2d800), last request at 1788940948 00000020:00000080:1.0:1788941054.844549:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e34c 00000020:00080000:1.0:1788941054.844557:0:20695:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbfed2d800): rc 0 00000020:00000080:1.0:1788941054.844561:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfed2d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788941054.844935:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbcb907000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788941054.844948:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfed2d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788941054.850962:0:20695:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788941054.850973:0:20695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788941054.850978:0:20695:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788941054.850987:0:20695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788941054.851021:0:2722:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfed2e000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788941054.851248:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941054.851256:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788941054.851261:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbfed2b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788941054.851264:0:20695:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfed2b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788941054.851270:0:20695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788941054.851348:0:20695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cac8897000 1 00000020:00000080:3.0:1788941054.851354:0:20695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e23b 00000020:00000080:3.0:1788941054.851360:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cbcb902000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788941054.851368:0:20695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788941054.851374:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbcb902000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788941054.851381:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788941054.851385:0:20695:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788941054.851388:0:20695:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99cac7aa3380) has no exports 00000020:00000080:0.0:1788941054.907331:0:20695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788941054.907347:0:20695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788941054.907354:0:20695:0:(genops.c:885:class_export_put()) final put ffff99cac8893000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788941054.907359:0:20695:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac8893000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788941054.907372:0:20695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788941054.907502:0:20695:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cac8894000 00000020:02000400:0.0:1788941054.907573:0:20695:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788941055.365279:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941055.905594:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788941055.905624:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102274176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788941055.905711:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941055.905767:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102274176 00000100:00100000:1.0:1788941055.905775:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102274176 00000100:00100000:1.0:1788941055.905860:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788941055.905871:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102274176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788941055.905904:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788941055.905924:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941055.905959:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102274176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941055.905966:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788941055.905995:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102274176:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788941056.399911:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788941056.519477:0:17876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788941057.440341:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788941057.925304:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788941057.925313:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788941057.925317:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cc01a03800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941057.925325:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 661 00000100:00080000:3.0:1788941057.925331:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788941057.925342:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cc01a03800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941057.925368:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b84380 x1875840102274432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941057.925421:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788941057.925425:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788941057.925427:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cbc4672800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941057.925430:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 661 00000100:00080000:3.0:1788941057.925447:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788941057.925453:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbc4672800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941057.925466:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe56e0000 x1875840102274816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941057.925476:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788941057.925480:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788941057.925481:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cbc9c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941057.925485:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 661 00000100:00080000:3.0:1788941057.925487:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788941057.925492:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc9c65000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941057.925502:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe56e2300 x1875840102274944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941057.925519:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788941057.925523:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788941057.925524:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cac6624000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941057.925527:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 661 00000100:00080000:3.0:1788941057.925530:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788941057.925534:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cac6624000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941057.925545:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe56e0380 x1875840102275200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788941057.925585:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102274560:0@lo:400:kworker.0 00000100:00100000:3.0:1788941057.925672:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941057.925907:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102274304:0@lo:400:kworker.0 00000400:00000100:1.0:1788941057.925939:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875840102274304 offset 0 length 224: 4 00000100:00100000:1.0:1788941057.925963:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875840102275328:0@lo:400:kworker.0 00000100:00100000:1.0:1788941057.925986:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941057.926010:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788941057.926027:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875840102275072:0@lo:400:kworker.0 00000100:00100000:1.0:1788941057.926050:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941057.926080:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102275328 00000100:00100000:1.0:1788941057.926087:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102275328 00000100:00100000:1.0:1788941057.926147:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102275072 00000100:00100000:1.0:1788941057.926151:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102275072 00000100:00100000:1.0:1788941057.926173:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788941057.926182:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875840102275328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941057.926230:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875840102275328:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941057.926238:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788941057.926256:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788941057.926262:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875840102275072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941057.926289:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875840102275072:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941057.926294:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1788941057.926335:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff99cbe56e1880 x1875840102275072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941057.926349:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875840102275072:0@lo:400:kworker.0 00010000:00080000:1.0:1788941057.926359:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff99cbe56e0700 x1875840102275328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941057.926379:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875840102275328:0@lo:400:kworker.0 00000100:00100000:2.0:1788941057.926998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102274432:0@lo:38:kworker.0 00000100:00100000:2.0:1788941057.927045:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941057.927076:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875840102274816:0@lo:38:kworker.0 00000100:00100000:0.0:1788941057.927104:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102274432 00000100:00100000:0.0:1788941057.927111:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102274432 00000100:00100000:2.0:1788941057.927116:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941057.927152:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875840102274944:0@lo:38:kworker.0 00000100:00100000:0.0:1788941057.927158:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788941057.927165:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102274432:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788941057.927179:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1788941057.927187:0:17127:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788941057.927198:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875840102275200:0@lo:38:kworker.0 00000100:00100000:2.0:1788941057.927234:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941057.927263:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102274816 00000100:00100000:2.0:1788941057.927267:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102274816 00000100:00100000:2.0:1788941057.927287:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102274944 00000100:00100000:2.0:1788941057.927290:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102274944 00000100:00100000:2.0:1788941057.927298:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102275200 00000100:00100000:2.0:1788941057.927301:0:18886:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102275200 00000100:00100000:2.0:1788941057.927309:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788941057.927314:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102274816:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788941057.927327:0:18886:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788941057.927360:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102274816:12345-0@lo:38:kworker.0 Request processed in 45us (245us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788941057.927367:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788941057.927380:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788941057.927384:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102274944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788941057.927392:0:18886:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788941057.927413:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102274944:12345-0@lo:38:kworker.0 Request processed in 28us (235us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788941057.927426:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788941057.927438:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788941057.927441:0:18886:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102275200:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788941057.927450:0:18886:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788941057.927474:0:18886:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875840102275200:12345-0@lo:38:kworker.0 Request processed in 31us (240us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788941057.927480:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788941057.927510:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc4672800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941057.927515:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788941057.927518:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875840102274816:0@lo:38:kworker.0 00000100:00080000:2.0:1788941057.927528:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc9c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941057.927531:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788941057.927533:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875840102274944:0@lo:38:kworker.0 00000100:00080000:2.0:1788941057.927540:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac6624000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941057.927543:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788941057.927545:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875840102275200:0@lo:38:kworker.0 00000100:00100000:3.0:1788941057.928255:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788941057.928269:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102274688:0@lo:400:kworker.0 00000100:00100000:3.0:1788941057.928319:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941057.942591:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102274560 00000100:00100000:2.0:1788941057.942607:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102274560 00000100:00100000:3.0:1788941057.942647:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102275456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788941057.942707:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941057.942978:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102274688 00000100:00100000:2.0:1788941057.942983:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102274688 00000100:00100000:2.0:1788941057.943018:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788941057.943027:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102274560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941057.943081:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102274560:12345-0@lo:400:kworker.0 Request processed in 56us (17409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941057.943100:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788941057.943127:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788941057.943134:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102274688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941057.943169:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102274688:12345-0@lo:400:kworker.0 Request processed in 35us (14850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941057.943174:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788941057.944048:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788941057.944054:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788941057.944056:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788941057.947996:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102274688:0@lo:400:kworker.0 00000100:00100000:3.0:1788941057.948013:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102274560:0@lo:400:kworker.0 00000100:00100000:3.0:1788941057.948174:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102275456 00000100:00100000:3.0:1788941057.948182:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102275456 00000100:00100000:3.0:1788941057.948237:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788941057.948247:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102275456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788941057.948281:0:18632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788941057.948360:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102275456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (5653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941057.948369:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788941057.948435:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102275456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788941057.974619:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102274432:12345-0@lo:38:kworker.0 Request processed in 47448us (47568us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788941057.974633:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788941057.975189:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01a03800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788941057.975196:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788941057.975509:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102274432:0@lo:38:kworker.0 00010000:00010000:3.0:1788941058.501261:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941059.526391:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788941059.587817:0:20903:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788941059.602099:0:20903:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788941059.602160:0:20903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.602174:0:20903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.602180:0:20903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.602185:0:20903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.602207:0:20903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788941059.602212:0:20903:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788941059.602241:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788941059.602246:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788941059.602252:0:20903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788941059.602259:0:20903:0:(import.c:65:import_set_state_nolock()) ffff99cbc4672800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788941059.602264:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788941059.602266:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00010000:00010000:0.0:1788941059.602268:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788941059.602270:0:20903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788941059.602278:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941059.602286:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfeb1e200 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:0.0:1788941059.602290:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941059.602309:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788941059.602317:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941059.602323:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788941059.602326:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788941059.602328:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788941059.602371:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941059.602377:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788941059.602416:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941059.602424:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e200/0x24b6539075b3e43a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e441 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941059.602437:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941059.602439:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941059.602441:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941059.602449:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941059.602466:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102275584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788941059.602538:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941059.602605:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102275584 00000100:00100000:0.0:1788941059.602614:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102275584 00000100:00100000:0.0:1788941059.602654:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941059.602662:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3649:x1875840102275584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788941059.602675:0:17109:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788941059 with bad export cookie 2645393711041864293 00010000:00010000:1.0:1788941059.603245:0:20903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603256:0:20903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603274:0:20903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603281:0:20903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603302:0:20903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941059.603309:0:20903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603316:0:20903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603323:0:20903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603329:0:20903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603340:0:20903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788941059.603345:0:20903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603352:0:20903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603358:0:20903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603375:0:20903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603388:0:20903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788941059.603394:0:20903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603401:0:20903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603408:0:20903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603415:0:20903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941059.603422:0:20903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788941059.603426:0:20903:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788941059.603448:0:20903:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788941059.603451:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788941059.603456:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788941059.603462:0:20903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788941059.603467:0:20903:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff99cac66bd800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788941059.603473:0:20903:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff99cbf93cf800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788941059.603478:0:20903:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff99cbfdb6cd40) has exports, disconnecting them 00000020:00080000:1.0:1788941059.603482:0:20903:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99cac66bd800), last request at 1788941057 00000020:00000080:1.0:1788941059.603490:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e67f 00000100:00080000:1.0:1788941059.603504:0:20903:0:(import.c:65:import_set_state_nolock()) ffff99cac66be000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788941059.603552:0:20903:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cac66bd800): rc 0 00000020:00000080:1.0:1788941059.603555:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cac66bd800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788941059.603565:0:20903:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99cbf93cf800), last request at 1788941057 00000020:00000080:1.0:1788941059.603569:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e51a 00000100:00080000:1.0:1788941059.603574:0:20903:0:(import.c:65:import_set_state_nolock()) ffff99cac7bbb000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788941059.603580:0:20903:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbf93cf800): rc 0 00000020:00000080:1.0:1788941059.603582:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf93cf800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788941059.603589:0:20903:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb1f201da3ae0 00000100:00080000:1.0:1788941059.603605:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788941059.603614:0:20903:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff99cac19f9f80 x1875840102272384/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788941067 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941059.603624:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788941059.604538:0:20903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788941059.604546:0:20903:0:(import.c:65:import_set_state_nolock()) ffff99cc01a03800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788941059.604713:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788941059.604717:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788941059.604728:0:20903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788941059.604802:0:20903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788941059.604827:0:20903:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788941059.604864:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788941059.604867:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788941059.604875:0:20903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788941059.604938:0:20903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788941059.604948:0:20903:0:(import.c:65:import_set_state_nolock()) ffff99cbf6b91800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788941059.604985:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff99cbfdb6cd40) has no exports 00000100:00100000:3.0:1788941059.605240:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac19f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102272384:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788941059.605275:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788941059.605299:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605311:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a28e00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941059.605341:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605353:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941059.605370:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941059.605375:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788941059.605376:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788941059.605379:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788941059.605411:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605416:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941059.605449:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941059.605459:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788941059.605466:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28e00/0x24b6539075b3e399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e3a0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941059.605476:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102275968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941059.605477:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788941059.605481:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605494:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cc021e7e00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941059.605496:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605501:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941059.605511:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941059.605515:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788941059.605524:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788941059.605526:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788941059.605537:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941059.605544:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941059.605553:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941059.605561:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605566:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cc021e7e00/0x24b6539075b3e68d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e694 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605587:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941059.605589:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605593:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40800 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941059.605595:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605599:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941059.605603:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941059.605621:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788941059.605623:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788941059.605624:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788941059.605632:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605636:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941059.605657:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941059.605659:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102276096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941059.605665:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3e823 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e82a expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605672:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941059.605675:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605688:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a28200 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941059.605690:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941059.605697:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941059.605699:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941059.605705:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941059.605708:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788941059.605724:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788941059.605730:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:1.0:1788941059.605734:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102275968 00000100:00100000:1.0:1788941059.605742:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102275968 00010000:00010000:3.0:1788941059.605755:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941059.605760:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941059.605767:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941059.605767:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102276096 00000100:00100000:1.0:1788941059.605773:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102276096 00010000:00010000:3.0:1788941059.605774:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28200/0x24b6539075b3e38b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b6539075b3e392 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941059.605790:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788941059.605792:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941059.605795:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941059.605797:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941059.605801:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3652:x1875840102275968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788941059.605809:0:17108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788941059 with bad export cookie 2645393711041864293 00000100:00100000:3.0:1788941059.605818:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102275712:0@lo:9:umount.0 00000100:00100000:1.0:1788941059.605876:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3652:x1875840102275968:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (335us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788941059.605884:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788941059.605893:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941059.605903:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788941059.605908:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbdddd4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3652:x1875840102276096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788941059.605912:0:17108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788941059 with bad export cookie 2645393711041864293 00000100:00100000:3.0:1788941059.605932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102275840:0@lo:9:umount.0 00000100:00100000:1.0:1788941059.605943:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbdddd4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3652:x1875840102276096:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (248us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788941059.605949:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788941059.605971:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788941059.605985:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788941059.605989:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99cbc49e0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788941059.605994:0:3652:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788941059.607270:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788941059.607288:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac66bd800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788941059.607355:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf93cf800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788941059.607379:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac66be000 for lustre-MDT0001 00000020:00000080:2.0:1788941059.607385:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac7bbb000 for lustre-MDT0001 00000100:00100000:2.0:1788941059.607412:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102275712 00000100:00100000:2.0:1788941059.607419:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102275712 00000100:00100000:2.0:1788941059.607469:0:18629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102275840 00000100:00100000:2.0:1788941059.607472:0:18629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102275840 00000100:00100000:2.0:1788941059.607498:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788941059.607508:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac19f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875840102275712:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788941059.607536:0:18629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e544 00000100:00080000:2.0:1788941059.607544:0:18629:0:(import.c:65:import_set_state_nolock()) ffff99cbfea40800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788941059.607584:0:18629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788941059.607741:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac19f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3648:x1875840102275712:12345-0@lo:9:umount.0 Request processed in 235us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941059.607749:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788941059.607763:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788941059.607779:0:18629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875840102275840:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788941059.607793:0:18629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e6b0 00000100:00080000:2.0:1788941059.607799:0:18629:0:(import.c:65:import_set_state_nolock()) ffff99cac66bb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788941059.607820:0:18629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788941059.609949:0:18629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3648:x1875840102275840:12345-0@lo:9:umount.0 Request processed in 2160us (3967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941059.609963:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788941059.610043:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788941059.610048:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788941059.610064:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788941059.610115:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788941059.610134:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788941059.610136:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788941059.610141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102275712:0@lo:9:umount.0 00000100:00080000:2.0:1788941059.610166:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbf6b91800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788941059.610175:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788941059.610177:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788941059.610440:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102275840:0@lo:9:umount.0 00010000:00010000:2.0:1788941059.610482:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788941059.637941:0:3652:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.142@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788941059.637946:0:3652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788941059.637957:0:3652:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbe572f800 x1875840102274304/t0(0) o400->MGC192.168.201.142@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788941073 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941059.637971:0:3652:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbfeb94000 x1875840102275584/t0(0) o103->MGC192.168.201.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788941075 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941059.638004:0:3652:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbe56e3480 x1875840102275968/t0(0) o103->MGC192.168.201.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788941075 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941059.638011:0:3652:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbe56e0000 x1875840102276096/t0(0) o103->MGC192.168.201.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788941075 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788941059.638024:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788941059.638027:0:3652:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788941059.638029:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788941059.638032:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:0:1875840102276352:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788941059.638034:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99cbc49e0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941059.638043:0:3652:0:(import.c:545:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 556 00000100:00100000:0.0:1788941059.638048:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:0:1875840102276224:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788941059.638058:0:3652:0:(import.c:666:import_select_connection()) MGC192.168.201.142@tcp: import ffff99cbc49e0800 using connection 192.168.201.142@tcp/0@lo 00010000:00010000:0.0:1788941059.638075:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941059.638194:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3649:x1875840102275584:12345-0@lo:103:ldlm_bl.0 Request processed in 35530us (35654us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788941059.638217:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941059.638289:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3649:1875840102275584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941059.643483:0:3652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8596a00 x1875840102276480/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941059.643581:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3648:1875840102276480:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788941059.643635:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875840102276480 offset 0 length 520: 4 00000100:00100000:1.0:1788941059.643699:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102275968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941059.643708:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102274304:0@lo:400:kworker.0 00000100:00100000:1.0:1788941059.643729:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3652:1875840102276096:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788941059.652375:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff99cbfdb6cd40) has no exports 00000020:01000000:0.0:1788941059.696018:0:20903:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cbc8fba900 - data ffff99cbed85abd0/ffff99cac13a5800 00000020:01000000:0.0:1788941059.696195:0:20903:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cbfec4fa20 - data ffff99cbed8bc510/ffff99cbf49e9400 00000001:00000004:0.0:1788941059.727103:0:20903:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1788941059.768641:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788941059.768651:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788941059.768659:0:20903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788941059.772572:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788941059.772583:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788941059.772607:0:20903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788941059.772609:0:20903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788941059.773248:0:17864:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788941059.773254:0:17864:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788941059.773266:0:17864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788941059.773806:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788941059.773810:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788941059.773829:0:20903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788941059.773851:0:20903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788941059.776787:0:17866:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788941059.776797:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788941059.776813:0:17866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788941059.782412:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e3ae 00000020:00000080:0.0:1788941059.782425:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf6b91000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788941059.783582:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e3c3 00000020:00000080:0.0:1788941059.783593:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf6b90800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788941059.783599:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788941059.783605:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788941059.783616:0:20903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788941059.783621:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99cbfdb699c0) has no exports 00000004:01000000:0.0:1788941059.783900:0:20903:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788941059.783911:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e417 00000020:00000080:0.0:1788941059.783916:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbc91d0000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788941059.783933:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788941059.783936:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788941059.783941:0:20903:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788941059.783944:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff99cbfd808000) has no exports 00000020:00000080:0.0:1788941059.783950:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e410 00000020:00000080:0.0:1788941059.783954:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf6b92800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788941059.784438:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b91000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788941059.784450:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b90800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1788941059.784463:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc91d0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788941059.784468:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b92800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788941059.785435:0:20903:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788941059.785443:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788941059.785449:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788941059.785458:0:20903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788941059.785461:0:20903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788941059.787498:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788941059.787515:0:20903:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788941059.787525:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e402 00000020:00000080:0.0:1788941059.787535:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cc01aba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788941059.789131:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbf6b91800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788941059.789149:0:38:0:(genops.c:885:class_export_put()) final put ffff99cbc91d2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788941059.789152:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc91d2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788941059.789159:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788941059.789530:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788941059.789640:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788941059.789652:0:20903:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788941059.789657:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff99cac7aa4d40) has no exports 00000020:00000080:0.0:1788941059.789667:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e3f4 00000020:00000080:0.0:1788941059.789687:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cc01abe000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788941059.792030:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01aba000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:0.0:1788941059.793550:0:20903:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788941059.793559:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788941059.793564:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788941059.793572:0:20903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788941059.793575:0:20903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788941059.794562:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01abe000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788941059.794797:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788941059.794812:0:20903:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788941059.794830:0:20903:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788941059.794854:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e3e6 00000020:00000080:0.0:1788941059.794866:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cc01ab8800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788941059.794872:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788941059.794890:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788941059.794896:0:20903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788941059.794900:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99cbcbce99c0) has no exports 00000020:00000080:0.0:1788941059.794907:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e3df 00000020:00000080:0.0:1788941059.794912:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cc01a06000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788941059.797881:0:20903:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788941059.797890:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788941059.797944:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788941059.797953:0:20903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788941059.797997:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941059.798007:0:20903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788941059.798035:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941059.798039:0:20903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788941059.798044:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cac7940800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788941059.798055:0:20903:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac7940800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788941059.798063:0:20903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788941059.798230:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e3ca 00000020:00000080:3.0:1788941059.798237:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf6b93000/lustre-MDD0001_UUID 00000020:01000000:3.0:1788941059.798242:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788941059.798246:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788941059.798251:0:20903:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788941059.798255:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99cbfdb6b380) has no exports 00000020:00000080:3.0:1788941059.798276:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941059.798279:0:20903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788941059.798283:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e3d1 00000020:00000080:3.0:1788941059.798286:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf6b90000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788941059.798301:0:20903:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbd5cc7000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788941059.798305:0:20903:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbd5cc7000 2 00000020:01000004:3.0:1788941059.798309:0:20903:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cbd5cc7000 from lustre-MDT0001 00000020:00000080:3.0:1788941059.798325:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941059.798329:0:20903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788941059.798331:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf6b95000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788941059.798333:0:20903:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b95000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788941059.798342:0:20903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788941059.798373:0:20903:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788941059.798377:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788941059.798907:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788941059.798912:0:20903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788941059.798919:0:20903:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff99cbc4674000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788941059.798925:0:20903:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff99cbf93a3380) has exports, disconnecting them 00000020:00080000:3.0:1788941059.798930:0:20903:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff99cbc4674000), last request at 1788940964 00000020:00000080:3.0:1788941059.798934:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e44f 00000020:00080000:3.0:1788941059.798944:0:20903:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbc4674000): rc 0 00000020:00000080:3.0:1788941059.798947:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbc4674000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788941059.799584:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cc01ab9000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788941059.799593:0:38:0:(genops.c:885:class_export_put()) final put ffff99cc01abe800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788941059.799596:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01abe800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788941059.799605:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788941059.799900:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01ab8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788941059.799908:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01a06000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788941059.799914:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cc01a03800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788941059.799920:0:38:0:(genops.c:885:class_export_put()) final put ffff99cac841a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788941059.799922:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac841a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788941059.799925:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788941059.800041:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b93000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788941059.800046:0:38:0:(genops.c:885:class_export_put()) final put ffff99cbf6b95800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788941059.800048:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b95800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788941059.800051:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788941059.800160:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b90000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788941059.800166:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc4674000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788941059.813026:0:20903:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788941059.813036:0:20903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788941059.813048:0:20903:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788941059.813057:0:20903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788941059.813096:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbc4672800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788941059.813288:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788941059.813424:0:20903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788941059.813431:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf93c8800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788941059.813436:0:20903:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf93c8800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788941059.813442:0:20903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788941059.813520:0:20903:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbd5cc7000 1 00000020:00000080:1.0:1788941059.813527:0:20903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e376 00000020:00000080:1.0:1788941059.813534:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbf6b8a000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788941059.813544:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788941059.813553:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b8a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788941059.813563:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788941059.813569:0:20903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788941059.813573:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff99cac7aa0000) has no exports 00000020:00000080:0.0:1788941060.045524:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788941060.045540:0:20903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788941060.045546:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbc9c62000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788941060.045551:0:20903:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc9c62000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788941060.045566:0:20903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788941060.045694:0:20903:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cbc9c63800 00000020:01000000:0.0:1788941060.045716:0:20903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788941060.045721:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788941060.045726:0:20903:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788941060.045731:0:20903:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff99cbfd8099c0) has no exports 00000100:00100000:2.0:1788941060.047700:0:18886:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff99cac7a7c600:18886] 3 exiting: rc = 0 00000100:00100000:2.0:1788941060.048314:0:17122:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff99cbfede1400:17122] 0 exiting: rc = 1 00000100:00100000:2.0:1788941060.048428:0:17124:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff99cbc48dd400:17124] 2 exiting: rc = 0 00000100:00100000:1.0:1788941060.048830:0:17123:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff99cbc48dde00:17123] 1 exiting: rc = 0 00000100:00100000:2.0:1788941060.049250:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049258:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049264:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049269:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049274:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049278:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049283:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049297:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049303:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049308:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049314:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049319:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049324:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049330:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049335:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049341:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049347:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049353:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049358:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049364:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049370:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049376:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049381:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049387:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049393:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049398:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049403:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049409:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049415:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049421:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049428:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049434:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049439:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049445:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049451:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049457:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049464:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049469:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049474:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049479:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049484:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049501:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049513:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049518:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049523:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049529:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049533:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049539:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049544:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049549:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049554:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049558:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049563:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049569:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049573:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049579:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049585:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049590:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049595:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049601:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049608:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049613:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049619:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.049624:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.056438:0:17125:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99cac6834200:17125] 0 exiting: rc = 1 00000100:00100000:1.0:1788941060.056876:0:17126:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99cac6834800:17126] 1 exiting: rc = 0 00000100:00100000:2.0:1788941060.057071:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057092:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057099:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057106:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057111:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057116:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057122:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057127:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057133:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057138:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057143:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057159:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057179:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057184:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057189:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057195:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057200:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057205:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057210:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057215:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057221:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057226:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057232:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057238:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057245:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057250:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057255:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057261:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057266:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057271:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057276:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057282:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057288:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057293:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057299:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057304:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057310:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057315:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057320:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057327:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057332:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057337:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057342:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057349:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057354:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057360:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057365:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057380:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057386:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057390:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057597:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057606:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057611:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057616:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057621:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057626:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057632:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057637:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057651:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057658:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057664:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057669:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057674:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788941060.057680:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.059617:0:19458:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff99cac6695a00:19458] 2 exiting: rc = 0 00000100:00100000:2.0:1788941060.059973:0:17128:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99cbc48dc600:17128] 1 exiting: rc = 0 00000100:00100000:0.0:1788941060.072164:0:17127:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff99cbc48dc400:17127] 0 exiting: rc = 1 00000100:00100000:1.0:1788941060.072343:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072351:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072358:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072364:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072385:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072391:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072407:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072414:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072422:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072428:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072434:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072441:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072448:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072471:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072478:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072484:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072503:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072510:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072517:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072525:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072532:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072538:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072544:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072551:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072557:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072563:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072569:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072575:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072602:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072610:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072615:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072622:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072629:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072635:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072641:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072647:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072653:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072658:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072664:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072671:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072689:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072695:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072701:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072706:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072714:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072721:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072727:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072733:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072745:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072752:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072758:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072764:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072781:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072787:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072793:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072799:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072805:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072811:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072817:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072822:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072828:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072865:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072873:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.072879:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.095353:0:17130:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99cbc6542800:17130] 1 exiting: rc = 0 00000100:00100000:3.0:1788941060.103513:0:17129:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99cbc6543200:17129] 0 exiting: rc = 1 00000100:00100000:1.0:1788941060.107874:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107885:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107890:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107896:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107901:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107906:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107911:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107916:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107920:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107925:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107930:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107935:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107940:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107944:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107949:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107953:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107958:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107963:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107968:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107988:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107993:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.107998:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108003:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108008:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108013:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108018:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108024:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108029:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108034:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108039:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108044:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108049:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108054:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108059:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108065:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108071:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108076:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108092:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108097:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108104:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108109:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108113:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108118:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108123:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108129:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108133:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108138:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108143:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108148:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108153:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108158:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108163:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108168:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108173:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108187:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108191:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108197:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108202:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108207:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108211:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108217:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108222:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108226:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.108232:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941060.109827:0:17132:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99cbc6542a00:17132] 1 exiting: rc = 0 00000100:00100000:1.0:1788941060.114032:0:17131:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99cbc6543800:17131] 0 exiting: rc = 1 00000100:00100000:0.0:1788941060.114200:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114209:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114214:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114219:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114225:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114230:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114235:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114240:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114246:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114253:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114258:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114264:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114269:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114274:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114280:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114285:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114300:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114306:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114312:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114317:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114321:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114326:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114331:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114336:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114342:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114347:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114353:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114359:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114364:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114370:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114374:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114380:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114385:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.114390:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117097:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117107:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117113:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117119:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117124:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117129:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117135:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117139:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117144:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117149:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117154:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117158:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117163:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117168:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117174:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117179:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117184:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117201:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117207:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117212:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117217:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117222:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117227:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117232:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117237:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117242:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117248:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117252:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117258:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.117263:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.120481:0:17134:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff99cbc6543c00:17134] 1 exiting: rc = 0 00000100:00100000:2.0:1788941060.120579:0:17133:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99cbc6542400:17133] 0 exiting: rc = 1 00000100:00100000:0.0:1788941060.120947:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120955:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120960:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120965:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120971:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120976:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120981:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120986:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120992:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.120998:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121003:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121008:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121014:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121019:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121025:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121031:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121036:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121042:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121047:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121052:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121057:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121062:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121088:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121095:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121100:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121105:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121109:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121114:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121120:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121125:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121130:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121135:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121139:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121144:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121150:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121155:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121160:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121165:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121170:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121175:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121181:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121186:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121191:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121196:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121202:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121207:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121213:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121218:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121223:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121228:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121234:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121239:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121244:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121249:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121254:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121259:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121264:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121277:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121283:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121288:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121294:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121299:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121304:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.121308:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941060.122004:0:17135:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff99cbcbc01800:17135] 0 exiting: rc = 1 00000100:00100000:0.0:1788941060.122240:0:17137:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff99cbd5ee9c00:17137] 2 exiting: rc = 0 00000100:00100000:2.0:1788941060.125431:0:17136:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff99cbd5ee9800:17136] 1 exiting: rc = 0 00000100:00100000:0.0:1788941060.125778:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125788:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125794:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125799:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125806:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125812:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125817:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125823:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125829:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125861:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125867:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125872:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125878:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125884:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125889:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125895:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125902:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125907:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125913:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125919:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125926:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125931:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125936:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125941:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125961:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125968:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125974:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.125995:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126000:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126006:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126012:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126018:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126025:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126031:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126037:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126042:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126048:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126054:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126060:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126066:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126073:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126089:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126097:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126105:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126111:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126117:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126123:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126128:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126150:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126158:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126164:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126170:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126176:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126183:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126189:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126195:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126200:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126206:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126211:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126217:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126223:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126229:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126241:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941060.126247:0:20903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788941060.130988:0:20903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788941060.131006:0:20903:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788941060.131014:0:20903:0:(genops.c:885:class_export_put()) final put ffff99cbc49e2000/MDS_uuid 00000020:00000080:0.0:1788941060.131019:0:20903:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc49e2000/MDS_uuid for MDS 00000020:01000000:0.0:1788941060.131026:0:20903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788941060.131178:0:20903:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788941060.570957:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941061.580463:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941062.596349:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788941063.045275:0:2722:0:(pinger.c:229:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941063.045287:0:2722:0:(pinger.c:247:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941063.045291:0:2722:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941063.045295:0:2722:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788941063.045300:0:2722:0:(import.c:65:import_set_state_nolock()) ffff99cbc9c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941063.045310:0:2722:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1788941063.045317:0:2722:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788941063.045332:0:2722:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc9c65000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941063.045376:0:2722:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8597480 x1875840102276608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941063.045435:0:2722:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941063.045439:0:2722:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788941063.045441:0:2722:0:(import.c:65:import_set_state_nolock()) ffff99cac6624000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941063.045445:0:2722:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1788941063.045456:0:2722:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788941063.045461:0:2722:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cac6624000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941063.045475:0:2722:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8596300 x1875840102276864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941063.045516:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102276736:0@lo:400:kworker.0 00000100:00100000:3.0:1788941063.045783:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875840102276608:0@lo:38:kworker.0 00000400:00000100:1.0:1788941063.045784:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102276736 offset 0 length 224: 4 00000400:00000100:3.0:1788941063.045815:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102276608 offset 0 length 520: 4 00000100:00100000:3.0:1788941063.045869:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875840102276864:0@lo:38:kworker.0 00000400:00000100:3.0:1788941063.045893:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102276864 offset 0 length 520: 4 00000100:00100000:1.0:1788941063.045902:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941063.045912:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875840102276992:0@lo:400:kworker.0 00000400:00000100:1.0:1788941063.045932:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102276992 offset 0 length 224: 4 00010000:00010000:0.0:1788941063.626045:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788941064.523289:0:21105:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788941064.551230:0:21105:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788941064.551293:0:21105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941064.551311:0:21105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941064.551319:0:21105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941064.551326:0:21105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941064.551342:0:21105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788941064.551349:0:21105:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788941064.551375:0:21105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788941064.551388:0:21105:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8597480 x1875840102276608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788941083 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941064.551405:0:21105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788941064.551412:0:21105:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788941064.551418:0:21105:0:(import.c:65:import_set_state_nolock()) ffff99cbc9c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788941064.551424:0:21105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788941064.551443:0:21105:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8597480 x1875840102276608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788941083 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941064.551449:0:21105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788941064.551453:0:21105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1788941064.551582:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941064.551590:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941064.551598:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41c00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941064.551602:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941064.551611:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941064.551618:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941064.551624:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788941064.551626:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788941064.551629:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788941064.551641:0:17111:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cbc49e0800 00010000:00010000:1.0:1788941064.551653:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941064.551659:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3e4e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e4f0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941064.551670:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941064.551672:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941064.551673:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941064.551882:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875840102276608:0@lo:38:kworker.0 00000100:00080000:0.0:1788941064.555102:0:21105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788941064.555122:0:21105:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8595880 x1875840102276736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941064.555748:0:21105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788941064.555756:0:21105:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788941064.555784:0:21105:0:(import.c:65:import_set_state_nolock()) ffff99cac78fd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788941064.556061:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875840102277120:0@lo:39:umount.0 00000400:00000100:2.0:1788941064.556122:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102277120 offset 0 length 224: 4 00000100:00100000:3.0:1788941064.562336:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102276736:0@lo:400:kworker.0 00010000:00010000:1.0:1788941064.647251:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788941065.094282:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941065.094290:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941065.094293:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941065.094297:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941065.094375:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102277248:0@lo:400:kworker.0 00000400:00000100:1.0:1788941065.094430:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102277248 offset 0 length 224: 4 00000001:00100000:3.0:1788941065.097334:0:18624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788941065.097344:0:18624:0:(genops.c:885:class_export_put()) final put ffff99cbfea46800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788941065.097569:0:19443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788941065.097573:0:19443:0:(genops.c:885:class_export_put()) final put ffff99cac66b8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788941065.097600:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfea46800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788941065.097653:0:2722:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbfea40800 for lustre-OST0000 00000020:00000080:1.0:1788941065.098100:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac66b8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788941065.098218:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac66bb000 for lustre-OST0001 00010000:00010000:0.0:1788941065.668134:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941066.692314:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941067.716040:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788941068.100078:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788941068.100090:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788941068.100093:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788941068.100096:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788941068.100426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875840102277376:0@lo:400:kworker.0 00000400:00000100:3.0:1788941068.100498:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102277376 offset 0 length 224: 4 00010000:00010000:0.0:1788941068.741944:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941069.700527:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941059/real 1788941059] req@ffff99cac8596a00 x1875840102276480/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788941069 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941069.700560:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cac8596a00 x1875840102276480/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788941069 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941069.700598:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc49e0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941069.700628:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788941069.700631:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3648:1875840102276480:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1788941069.700723:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941069.700729:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788941069.700732:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cbc49e0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941069.700736:0:38:0:(import.c:545:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 668 00000100:00080000:1.0:1788941069.700742:0:38:0:(import.c:630:import_select_connection()) MGC192.168.201.142@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788941069.700753:0:38:0:(import.c:666:import_select_connection()) MGC192.168.201.142@tcp: import ffff99cbc49e0800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941069.700784:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8597b80 x1875840102277504/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941069.700817:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941069.700821:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788941069.700933:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941069.700949:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875840102277632:0@lo:400:kworker.0 00000400:00000100:0.0:1788941069.701077:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102277632 offset 0 length 224: 4 00000100:00100000:2.0:1788941069.701204:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3648:1875840102277504:0@lo:250:kworker.0 00000400:00000100:2.0:1788941069.701312:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875840102277504 offset 0 length 520: 4 00010000:00010000:1.0:1788941069.764125:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941070.794579:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941071.815889:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941072.836079:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941073.863611:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941074.820065:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941064/real 1788941064] req@ffff99cbfeb94000 x1875840102277120/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788941074 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941074.820099:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cbfeb94000 x1875840102277120/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788941074 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788941074.820120:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac78fd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788941074.820197:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875840102277120:0@lo:39:umount.0 00000100:00080000:1.0:1788941074.820445:0:21105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788941074.820450:0:21105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788941074.820455:0:21105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788941074.821335:0:2722:0:(pinger.c:229:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788941074.821343:0:2722:0:(pinger.c:247:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788941074.821346:0:2722:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788941074.821368:0:2722:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788941074.821503:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875840102277760:0@lo:400:kworker.0 00000400:00000100:2.0:1788941074.821555:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102277760 offset 0 length 224: 4 00010000:00010000:1.0:1788941074.823609:0:21105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941074.823628:0:21105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941074.823635:0:21105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941074.823642:0:21105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941074.823667:0:21105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941074.823675:0:21105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941074.823683:0:21105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941074.823707:0:21105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941074.823728:0:19659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941074.823738:0:19659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941074.823747:0:19659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfeb1e400 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:0.0:1788941074.823752:0:19659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941074.823762:0:19659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788941074.823770:0:19659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941074.823773:0:21105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941074.823778:0:19659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788941074.823785:0:19659:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788941074.823799:0:19659:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cbc49e0800 00010000:00010000:0.0:1788941074.823803:0:19659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941074.823809:0:21105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941074.823811:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e400/0x24b6539075b3e4bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e4c6 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941074.823816:0:21105:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788941074.823865:0:21105:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788941074.823898:0:21105:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788941074.823902:0:21105:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1788941074.823903:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941074.823911:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941074.823918:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40c00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:2.0:1788941074.823921:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941074.823929:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788941074.823935:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941074.823941:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788941074.823943:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788941074.823945:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788941074.823952:0:17111:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cbc49e0800 00010000:00010000:2.0:1788941074.823955:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941074.823969:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7f40c00/0x24b6539075b3e815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e81c expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941074.823985:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941074.823986:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941074.823988:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788941074.824032:0:21105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788941074.824039:0:21105:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788941074.824044:0:21105:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff99cbf48a8000) has no exports 00000020:00080000:1.0:1788941074.824071:0:21105:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff99cbf48a8000) has no exports 00010000:00010000:0.0:1788941074.824093:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941074.824095:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941074.824097:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788941074.826131:0:21105:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cbca24c240 - data ffff99cbed83ca20/ffff99cac5a29000 00000020:01000000:1.0:1788941074.826370:0:21105:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cbc8fba5a0 - data ffff99cbcac10798/ffff99cac7e31400 00100000:10000000:1.0:1788941074.838599:0:21105:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788941074.847049:0:21105:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e4d4 00000020:00000080:0.0:1788941074.847064:0:21105:0:(genops.c:885:class_export_put()) final put ffff99cbf6225800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788941074.847081:0:21105:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbfed16000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788941074.847105:0:21105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbfed16000 2 00000020:01000004:0.0:1788941074.847109:0:21105:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cbfed16000 from lustre-OST0000 00000020:00000080:0.0:1788941074.847140:0:21105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788941074.847153:0:21105:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788941074.847156:0:21105:0:(genops.c:885:class_export_put()) final put ffff99cbf6222000/lustre-OST0000_UUID 00000020:00000080:0.0:1788941074.847159:0:21105:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6222000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788941074.847167:0:21105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1788941074.847384:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6225800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1788941074.848045:0:21105:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788941074.848051:0:21105:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788941074.848055:0:21105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788941074.848061:0:21105:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788941074.848068:0:21105:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99cbf6b96800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788941074.848074:0:21105:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff99cbfe820000) has exports, disconnecting them 00000020:00080000:0.0:1788941074.848079:0:21105:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99cbf6b96800), last request at 1788940981 00000020:00000080:0.0:1788941074.848083:0:21105:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e4fe 00000020:00080000:0.0:1788941074.848095:0:21105:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbf6b96800): rc 0 00000020:00000080:0.0:1788941074.848100:0:21105:0:(genops.c:885:class_export_put()) final put ffff99cbf6b96800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788941074.848294:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbf6b96800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788941074.853690:0:21105:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788941074.853700:0:21105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788941074.853706:0:21105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788941074.853798:0:21105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788941074.854073:0:21105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788941074.854083:0:21105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788941074.854092:0:21105:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788941074.854118:0:21105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788941074.854124:0:21105:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788941074.854134:0:21105:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff99cac78fe000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788941074.854142:0:21105:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff99cbfe8219c0) has exports, disconnecting them 00000020:00080000:2.0:1788941074.854149:0:21105:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff99cac78fe000), last request at 1788940981 00000020:00000080:2.0:1788941074.854154:0:21105:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e513 00000020:00080000:2.0:1788941074.854173:0:21105:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cac78fe000): rc 0 00000020:00000080:2.0:1788941074.854181:0:21105:0:(genops.c:885:class_export_put()) final put ffff99cac78fe000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788941074.855513:0:2722:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbc9c65000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788941074.855524:0:2722:0:(genops.c:885:class_export_put()) final put ffff99cbc3926800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788941074.855527:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc3926800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788941074.855534:0:2722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788941074.855605:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac78fe000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788941074.855663:0:21105:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788941074.855667:0:21105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788941074.855671:0:21105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788941074.855675:0:21105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788941074.855693:0:2722:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac78fd800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788941074.856521:0:21105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941074.856531:0:21105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788941074.856534:0:21105:0:(genops.c:885:class_export_put()) final put ffff99cbc9c61800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788941074.856537:0:21105:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc9c61800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788941074.856541:0:21105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788941074.856575:0:21105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbfed16000 1 00000020:00000080:3.0:1788941074.856581:0:21105:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e4b1 00000020:00000080:3.0:1788941074.856586:0:21105:0:(genops.c:885:class_export_put()) final put ffff99cc01ad8800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788941074.856596:0:21105:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788941074.856607:0:2722:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01ad8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788941074.856616:0:21105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788941074.856620:0:21105:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788941074.856624:0:21105:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff99cbf48a99c0) has no exports 00000020:00000080:3.0:1788941074.927562:0:21105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941074.927578:0:21105:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788941074.927584:0:21105:0:(genops.c:885:class_export_put()) final put ffff99cbfed15800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788941074.927589:0:21105:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfed15800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788941074.927601:0:21105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788941074.927739:0:21105:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cbfed17000 00000020:02000400:3.0:1788941074.927801:0:21105:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788941074.950010:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941075.977185:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941076.997921:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941078.020967:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788941078.177875:0:21308:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788941078.185009:0:21308:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788941078.185283:0:21308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.185298:0:21308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.185307:0:21308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.185330:0:21308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.185349:0:21308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788941078.185356:0:21308:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788941078.185389:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941078.185396:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.185404:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfeb1ee00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941078.185408:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.185417:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941078.185425:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941078.185450:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788941078.185453:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788941078.185455:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788941078.185468:0:17111:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cbc49e0800 00010000:00010000:1.0:1788941078.185473:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.185480:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1ee00/0x24b6539075b3e64e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e655 expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.185501:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941078.185503:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941078.185505:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788941078.185518:0:21308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788941078.185530:0:21308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8596300 x1875840102276864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788941083 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941078.185547:0:21308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788941078.185553:0:21308:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788941078.185559:0:21308:0:(import.c:65:import_set_state_nolock()) ffff99cac6624000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788941078.185564:0:21308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788941078.185568:0:21308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8596300 x1875840102276864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788941083 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941078.185575:0:21308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788941078.185578:0:21308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1788941078.186209:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875840102276864:0@lo:38:kworker.0 00000100:00080000:0.0:1788941078.187376:0:21308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788941078.187386:0:21308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8595c00 x1875840102276992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941078.187408:0:21308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8595f80 x1875840102277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941081 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941078.187422:0:21308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbfeb94380 x1875840102277376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941084 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941078.187433:0:21308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8596a00 x1875840102277632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941085 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941078.187448:0:21308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbfeb96300 x1875840102277760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941090 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941078.187455:0:21308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788941078.187732:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875840102276992:0@lo:400:kworker.0 00000100:00100000:2.0:1788941078.187981:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875840102277760:0@lo:400:kworker.0 00000100:00100000:2.0:1788941078.187991:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875840102277632:0@lo:400:kworker.0 00000100:00100000:0.0:1788941078.188330:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102277248:0@lo:400:kworker.0 00000100:00080000:0.0:1788941078.188350:0:21308:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788941078.188374:0:21308:0:(import.c:65:import_set_state_nolock()) ffff99cac66bd000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788941078.188601:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875840102277376:0@lo:400:kworker.0 00000100:00100000:3.0:1788941078.188633:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875840102277888:0@lo:39:umount.0 00000400:00000100:3.0:1788941078.188682:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840102277888 offset 0 length 224: 4 00010000:00010000:3.0:1788941079.044809:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788941079.940420:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788941079.940430:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788941080.068932:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941081.092113:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941082.116242:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941083.140648:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941084.164751:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941084.355988:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941069/real 1788941069] req@ffff99cac8597b80 x1875840102277504/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788941084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941084.356026:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cac8597b80 x1875840102277504/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788941084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788941084.356046:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc49e0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941084.356056:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788941084.356060:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3648:1875840102277504:0@lo:250:kworker.0 00000100:00080000:1.0:1788941084.356762:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788941084.356769:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788941084.356773:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cbc49e0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941084.356778:0:38:0:(import.c:545:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1788941084.356784:0:38:0:(import.c:630:import_select_connection()) MGC192.168.201.142@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788941084.356798:0:38:0:(import.c:666:import_select_connection()) MGC192.168.201.142@tcp: import ffff99cbc49e0800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941084.356862:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8595880 x1875840102278016/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941084.357204:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3648:1875840102278016:0@lo:250:kworker.0 00000400:00000100:0.0:1788941084.357254:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875840102278016 offset 0 length 520: 4 00010000:00010000:3.0:1788941085.193985:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941086.213164:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941087.236577:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941088.263187:0:19659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941088.452115:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941078/real 1788941078] req@ffff99cbfeb95f80 x1875840102277888/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788941088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941088.452168:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cbfeb95f80 x1875840102277888/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788941088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788941088.452192:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac66bd000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788941088.452215:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875840102277888:0@lo:39:umount.0 00000100:00080000:0.0:1788941088.452778:0:21308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788941088.452784:0:21308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788941088.452789:0:21308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788941088.453733:0:21308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941088.453748:0:21308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941088.453756:0:21308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941088.453763:0:21308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941088.453806:0:21308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941088.453814:0:21308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941088.453821:0:21308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941088.453827:0:21308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941088.453862:0:21308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941088.453878:0:21308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788941088.453882:0:21308:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1788941088.453903:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788941088.453913:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788941088.453918:0:21308:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788941088.453925:0:21308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1788941088.453926:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5000 already unused, calling callback (ffffffffc12a3c20) 00000020:00000080:0.0:1788941088.453932:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:2.0:1788941088.453933:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788941088.453940:0:21308:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:2.0:1788941088.453944:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788941088.453947:0:21308:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff99cbfe824d40) has no exports 10000000:00010000:2.0:1788941088.453956:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941088.453963:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788941088.453966:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788941088.453969:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:0.0:1788941088.453981:0:21308:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff99cbfe824d40) has no exports 00010000:00010000:2.0:1788941088.454148:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cbc49e0800 00010000:00010000:2.0:1788941088.454155:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941088.454162:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3e624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e62b expref: -99 pid: 19442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941088.454177:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941088.454181:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941088.454198:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfeb1e800 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:2.0:1788941088.454202:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941088.454209:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788941088.454216:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941088.454222:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788941088.454224:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788941088.454226:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788941088.454231:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cbc49e0800 00010000:00010000:2.0:1788941088.454233:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941088.454240:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1e800/0x24b6539075b3e807 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e80e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941088.454254:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941088.454256:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941088.454258:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941088.456312:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788941088.464798:0:21308:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cbca24c360 - data ffff99cbed9be870/ffff99cbf5bdb000 00000020:01000000:0.0:1788941088.465965:0:21308:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cac7875120 - data ffff99cbc22b0438/ffff99cac13a6000 00100000:10000000:2.0:1788941088.498466:0:21308:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788941088.521587:0:21308:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e639 00000020:00000080:3.0:1788941088.521601:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cac5a74000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788941088.521622:0:21308:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbfea47000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788941088.521626:0:21308:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbfea47000 2 00000020:01000004:3.0:1788941088.521628:0:21308:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cbfea47000 from lustre-OST0001 00000020:00000080:3.0:1788941088.521655:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941088.521664:0:21308:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788941088.521667:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cac78ff800/lustre-OST0001_UUID 00000020:00000080:3.0:1788941088.521669:0:21308:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac78ff800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788941088.521675:0:21308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788941088.521782:0:21308:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f->MGS 00010000:00010000:3.0:1788941088.521799:0:21308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29600/0x24b6539075b3e37d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e384 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941088.521811:0:21308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29600/0x24b6539075b3e37d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e384 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941088.521817:0:21308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788941088.521856:0:21308:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788941088.521860:0:21308:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788941088.521875:0:21308:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cbc49e0800 00010000:00010000:3.0:1788941088.521879:0:21308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29600/0x24b6539075b3e37d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e384 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941088.521907:0:21308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1fc00/0x24b6539075b3e26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b6539075b3e273 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941088.521914:0:21308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1fc00/0x24b6539075b3e26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b6539075b3e273 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941088.521919:0:21308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788941088.521922:0:21308:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788941088.521923:0:21308:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788941088.521933:0:21308:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cbc49e0800 00010000:00010000:3.0:1788941088.521936:0:21308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfeb1fc00/0x24b6539075b3e26c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b6539075b3e273 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788941088.521953:0:21308:0:(import.c:65:import_set_state_nolock()) ffff99cbc49e0800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788941088.521957:0:21308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788941088.521959:0:21308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788941088.521960:0:21308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788941088.521965:0:21308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788941088.521974:0:21308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cac8595880 x1875840102278016/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788941104 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788941088.521996:0:21308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788941088.521999:0:21308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000020:00000080:0.0:1788941088.522112:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac5a74000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788941088.522158:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f:3648:1875840102278016:0@lo:250:kworker.0 10000000:01000000:3.0:1788941088.522444:0:21308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788941088.522452:0:21308:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e257 00000020:00000080:3.0:1788941088.522457:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cbc49e4000/a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f 00000020:01000000:3.0:1788941088.522473:0:21308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.142@tcp (flags='') 00000020:00000080:3.0:1788941088.522477:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788941088.522482:0:21308:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788941088.522485:0:21308:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99cbfd80cd40) has no exports 10000000:01000000:3.0:1788941088.522518:0:17119:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788941088.522567:0:21308:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.201.142@tcp: client import never connected 00000100:00080000:3.0:1788941088.522570:0:21308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788941088.522572:0:21308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788941088.522584:0:21308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788941088.522586:0:21308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788941088.522623:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788941088.522627:0:21308:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.142@tcp (uuid a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f) 00000020:01000000:3.0:1788941088.522632:0:21308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788941088.522635:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788941088.522638:0:21308:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788941088.522643:0:21308:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99cac6620800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788941088.522648:0:21308:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff99cbfe823380) has exports, disconnecting them 00000020:00080000:3.0:1788941088.522652:0:21308:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99cac6620800), last request at 1788941001 00000020:00000080:3.0:1788941088.522656:0:21308:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e663 00000020:00080000:3.0:1788941088.522665:0:21308:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cac6620800): rc 0 00000020:00000080:3.0:1788941088.522670:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cac6620800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788941088.523286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc49e4000/a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f for MGC192.168.201.142@tcp 00000020:00000080:0.0:1788941088.523295:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cbc49e0800 for MGC192.168.201.142@tcp 00000020:00000080:0.0:1788941088.523309:0:36:0:(genops.c:885:class_export_put()) final put ffff99cbcb905000/a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f 00000020:00000080:0.0:1788941088.523311:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbcb905000/a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f for MGC192.168.201.142@tcp 00000020:01000000:0.0:1788941088.523316:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.142@tcp (a9a0d5e0-a5d5-47f4-87b5-a0c1d5e8de9f) 00000020:00000080:0.0:1788941088.523544:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac6620800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788941088.523934:0:21308:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788941088.523938:0:21308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788941088.523942:0:21308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788941088.523947:0:21308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788941088.523964:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac6624000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788941088.524103:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788941088.524110:0:21308:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788941088.524113:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cac6622800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788941088.524115:0:21308:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac6622800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788941088.524119:0:21308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788941088.524153:0:21308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788941088.524157:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788941088.524160:0:21308:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788941088.524165:0:21308:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff99cac66be800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788941088.524170:0:21308:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff99cac66b0000) has exports, disconnecting them 00000020:00080000:0.0:1788941088.524173:0:21308:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff99cac66be800), last request at 1788941001 00000020:00000080:0.0:1788941088.524176:0:21308:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e678 00000020:00080000:0.0:1788941088.524187:0:21308:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cac66be800): rc 0 00000020:00000080:0.0:1788941088.524190:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cac66be800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788941088.524217:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac66be800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788941088.536589:0:21308:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788941088.536598:0:21308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788941088.536603:0:21308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788941088.536611:0:21308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788941088.539604:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cac66bd000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788941088.542233:0:19659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788941088.550934:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788941088.551186:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788941088.552185:0:17105:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99cbc3c47000:17105] 0 exiting: rc = 1 00000100:00100000:2.0:1788941088.553382:0:17106:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99cbfeb50600:17106] 1 exiting: rc = 0 00000100:00100000:1.0:1788941088.553935:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.554332:0:20151:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99cbe576d600:20151] 3 exiting: rc = 0 00000100:00100000:1.0:1788941088.554400:0:17108:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99cbfeb50200:17108] 1 exiting: rc = 0 00000100:00100000:0.0:1788941088.557234:0:17107:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99cbfeb50a00:17107] 0 exiting: rc = 1 00000100:00100000:0.0:1788941088.557338:0:17109:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99cbca6fa400:17109] 2 exiting: rc = 0 00000100:00100000:1.0:1788941088.557559:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557585:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557593:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557598:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557605:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557611:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557619:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557626:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557632:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557637:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557643:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557648:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557654:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557668:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557674:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557679:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557687:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557695:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557703:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557713:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557718:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557738:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557744:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557750:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557756:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557761:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557767:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557773:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557779:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557785:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557790:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557795:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557801:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557807:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557813:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557819:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557824:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557830:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557853:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557859:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557864:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557870:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557875:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557881:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557886:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557891:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557896:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557901:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557913:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557918:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557924:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557929:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557934:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557939:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557945:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557951:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557956:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557962:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557967:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557973:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557979:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557984:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557989:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.557994:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788941088.561058:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788941088.561189:0:21308:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788941088.561195:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cac6621800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788941088.561200:0:21308:0:(genops.c:844:class_export_destroy()) destroying export ffff99cac6621800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788941088.561205:0:21308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788941088.561451:0:21308:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbfea47000 1 00000020:00000080:1.0:1788941088.561458:0:21308:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x24b6539075b3e61d 00000020:00000080:1.0:1788941088.561464:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cc01aca000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788941088.561477:0:21308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788941088.562056:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01aca000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788941088.562220:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788941088.562227:0:21308:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788941088.562232:0:21308:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff99cbf9393380) has no exports 00000020:00000080:1.0:1788941088.771826:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788941088.771859:0:21308:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788941088.771864:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cbfea41000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788941088.771869:0:21308:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbfea41000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788941088.771892:0:21308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788941088.772719:0:21308:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cbfea40000 00000020:01000000:1.0:1788941088.772750:0:21308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788941088.772756:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788941088.772761:0:21308:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788941088.772766:0:21308:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff99cbcbceb380) has no exports 00000020:00000080:1.0:1788941088.772793:0:21308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788941088.772800:0:21308:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788941088.772804:0:21308:0:(genops.c:885:class_export_put()) final put ffff99cc01add000/OSS_uuid 00000020:00000080:1.0:1788941088.772806:0:21308:0:(genops.c:844:class_export_destroy()) destroying export ffff99cc01add000/OSS_uuid for OSS 00000020:01000000:1.0:1788941088.772811:0:21308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788941088.772867:0:17118:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788941088.787746:0:18627:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99cbc6c27c00:18627] 0 exiting: rc = 1 00000100:00100000:0.0:1788941088.787898:0:18629:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99cbc6c25e00:18629] 1 exiting: rc = 0 00000100:00100000:0.0:1788941088.798828:0:18630:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99cbc6de5800:18630] 2 exiting: rc = 0 00000100:00100000:1.0:1788941088.800451:0:19043:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99cbf905a600:19043] 3 exiting: rc = 0 00000100:00100000:1.0:1788941088.800580:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800590:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800596:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800601:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800607:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800612:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800617:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800621:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800625:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800631:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800636:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800641:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800646:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800651:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800655:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800660:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800665:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800670:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800675:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800679:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800685:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800706:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800711:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800716:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800721:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800726:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800730:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800735:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800739:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800744:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800749:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800754:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800760:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800766:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800770:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800776:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800782:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800787:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800792:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800797:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800802:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800806:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800812:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800818:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800823:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800829:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800852:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800858:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800862:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800867:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800872:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800877:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800881:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800887:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800892:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800896:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800909:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800913:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800919:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800925:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800931:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800936:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800942:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.800946:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.802291:0:18631:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99cbf902c000:18631] 0 exiting: rc = 1 00000100:00100000:1.0:1788941088.804363:0:18632:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99cbf902c800:18632] 1 exiting: rc = 0 00000100:00100000:1.0:1788941088.804453:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804460:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804465:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804470:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804475:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804491:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804497:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804503:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804508:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804514:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804519:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804525:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804530:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804535:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804540:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804546:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804550:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804556:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804562:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804567:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804582:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804588:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804593:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804599:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804604:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804625:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804629:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804634:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804639:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804644:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804648:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804653:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804659:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804664:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804669:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804675:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804680:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804685:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804691:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804696:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804702:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804708:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804714:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804719:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804724:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804730:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804735:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804741:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804746:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804752:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804757:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804763:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804768:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804773:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804779:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804784:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804791:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804797:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804803:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804809:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804821:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804827:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804848:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788941088.804854:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.812466:0:18633:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99cbc8ff0c00:18633] 0 exiting: rc = 1 00000100:00100000:0.0:1788941088.812740:0:18634:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99cbc8ff0400:18634] 1 exiting: rc = 0 00000100:00100000:0.0:1788941088.812894:0:18635:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99cbf4911c00:18635] 2 exiting: rc = 0 00000100:00100000:3.0:1788941088.813535:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813543:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813548:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813554:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813560:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813565:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813582:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813588:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813594:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813599:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813605:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813610:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813615:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813620:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813625:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813631:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813646:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813652:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813657:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813663:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813668:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813683:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813690:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813696:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813702:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813707:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813713:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813718:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813723:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813729:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813734:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813740:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813745:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813750:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813755:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813760:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813765:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813771:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813776:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813781:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813787:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813792:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813798:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813803:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813808:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813825:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813830:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813853:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813859:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813864:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813869:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813879:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813884:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813890:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813895:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813900:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813906:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813911:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813916:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813921:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813927:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813942:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813948:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.813961:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829103:0:18636:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99cbc49bca00:18636] 0 exiting: rc = 1 00000100:00100000:0.0:1788941088.829198:0:18637:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99cbc49bda00:18637] 1 exiting: rc = 0 00000100:00100000:0.0:1788941088.829261:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829269:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829274:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829279:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829285:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829290:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829296:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829301:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829306:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829312:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829317:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829321:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829326:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829338:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829344:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829350:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829356:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829361:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829366:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829371:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829376:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829381:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829386:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829392:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829397:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829416:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829421:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829426:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829432:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829437:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829443:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829448:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829454:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829459:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829465:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829470:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829475:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829727:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829738:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829743:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829749:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829755:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829760:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829766:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829772:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829777:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829782:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829787:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829793:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829797:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829802:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829807:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829811:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829816:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829821:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829825:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829830:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829863:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829869:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829874:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829887:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829893:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829898:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788941088.829903:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831040:0:18638:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99cbc8fda600:18638] 0 exiting: rc = 1 00000100:00100000:0.0:1788941088.831238:0:18639:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99cbc8fdbe00:18639] 1 exiting: rc = 0 00000100:00100000:3.0:1788941088.831341:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831349:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831354:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831360:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831366:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831389:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831397:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831403:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831410:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831416:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831425:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831431:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831439:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831444:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831451:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831463:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831477:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831514:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831521:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831527:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831534:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831549:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831556:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831562:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831580:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831587:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831593:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831599:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831605:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831626:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831634:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831639:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831644:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831650:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831656:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831662:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831668:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831674:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831679:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831684:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831690:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831708:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831715:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831722:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831728:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831734:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831739:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831744:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831751:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831758:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831762:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831769:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831776:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831797:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831804:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831811:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.831825:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.832333:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.832345:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.832351:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.832357:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.832363:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.832369:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788941088.832384:0:21308:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788941088.841308:0:21308:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788941115.967516:0:22074:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788941128.355902:0:22675:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788941128.355919:0:22675:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788941128.355927:0:22675:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788941128.356060:0:22675:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cbe5775000 00000020:01000004:2.0:1788941128.356079:0:22675:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788941128.356089:0:22675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788941128.356116:0:22675:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99cbf93919c0) 00000020:00000080:2.0:1788941128.356133:0:22675:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788941128.459128:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788941128.459830:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788941128.460622:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788941128.462152:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788941128.462355:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788941128.462642:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788941128.463010:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788941128.463211:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788941128.463419:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788941128.463595:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788941128.464179:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788941128.464403:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788941128.464601:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788941128.465106:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788941128.465357:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788941128.467261:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.467442:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.467666:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.468188:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.468418:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.468593:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.468927:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.469108:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.469328:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.469530:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.469792:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.470129:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.470349:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.470514:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.470720:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.471061:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.471234:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.471437:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.471631:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.472140:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.472354:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.472572:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.472907:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.473195:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.473363:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.473574:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.473925:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.474103:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.474316:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.474536:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788941128.474926:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.475155:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788941128.476164:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788941128.476472:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788941128.476662:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788941128.477893:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788941128.478090:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788941128.478293:0:22675:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:3.0:1788941128.479293:0:22675:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788941128.479525:0:22675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788941128.479534:0:22675:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788941128.479548:0:22675:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b6539075b3eb5d 00000020:01000004:3.0:1788941128.479555:0:22675:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788941128.479560:0:22675:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788941128.479565:0:22675:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cbe5775000 from MGS 00000020:01000004:3.0:1788941128.479568:0:22675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788941128.479578:0:22675:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99cac66b3380) 00000020:00000080:3.0:1788941128.479589:0:22675:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788941128.479669:0:22675:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbe5775000 from MGS, refs=2 00080000:01000000:3.0:1788941128.479675:0:22675:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788941128.479679:0:22675:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b6539075b3eb6b 00000100:00100000:3.0:1788941128.479807:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788941128.479996:0:22675:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788941128.480004:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788941128.480604:0:22675:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788941128.480613:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788941128.486407:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788941128.486612:0:22675:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788941128.486620:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788941128.487526:0:22675:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788941128.487536:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788941128.488354:0:22675:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788941128.488362:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788941128.489301:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941128.489306:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941128.489308:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941128.489512:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941128.489514:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941128.489516:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941128.491081:0:22675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788941128.494747:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788941128.499199:0:22675:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788941128.501205:0:22687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788941128.501267:0:22675:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788941128.501311:0:22675:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788941128.502024:0:22675:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788941128.502325:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941128.502496:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788941128.502503:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788941128.504411:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788941128.504421:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788941128.511614:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788941128.511632:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788941128.512582:0:22675:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788941128.512608:0:22675:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.142@tcp' 00000020:01000004:1.0:1788941128.512610:0:22675:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1788941128.512872:0:22692:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1788941128.512946:0:22675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.142@tcp (typ=mgc) 00000020:00000080:1.0:1788941128.512962:0:22675:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.142@tcp (ffff99cbf93a3380) 00000020:00000080:1.0:1788941128.512977:0:22675:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788941128.513083:0:22675:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbe5718000@MGC192.168.201.142@tcp: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788941128.513234:0:22675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.142@tcp-0 is initialized 00000040:01000000:1.0:1788941128.513241:0:22675:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788941128.515214:0:22693:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788941128.515302:0:22675:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.142@tcp (uuid 105d8f83-5ac4-4ff2-bc3d-61a34eb91c97) 00000020:00000080:0.0:1788941128.515328:0:22675:0:(genops.c:1384:class_connect()) connect: client 105d8f83-5ac4-4ff2-bc3d-61a34eb91c97, cookie 0x24b6539075b3eb79 00000100:00080000:0.0:1788941128.515344:0:22675:0:(import.c:545:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788941128.515360:0:22675:0:(import.c:666:import_select_connection()) MGC192.168.201.142@tcp: import ffff99cbe5718000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788941128.515404:0:22675:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfeb95500 x1875840102278144/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788941128.515436:0:22675:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 105d8f83-5ac4-4ff2-bc3d-61a34eb91c97->MGS 00000020:01000004:0.0:1788941128.515462:0:22675:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788941128.515469:0:22675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788941128.515484:0:22675:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99cbf48a8000) 00000020:00000080:0.0:1788941128.515495:0:22675:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788941128.515674:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3648:1875840102278144:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788941128.515770:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.515892:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102278144 00000100:00100000:1.0:1788941128.515900:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102278144 00000100:00100000:1.0:1788941128.515933:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941128.515941:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1875840102278144:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788941128.515973:0:22688:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 105d8f83-5ac4-4ff2-bc3d-61a34eb91c97@0@lo t0 exp 0000000000000000 cur 737 last 0 00000020:00000080:1.0:1788941128.515999:0:22688:0:(genops.c:1384:class_connect()) connect: client 105d8f83-5ac4-4ff2-bc3d-61a34eb91c97, cookie 0x24b6539075b3eb87 00000100:00080000:1.0:1788941128.516132:0:22688:0:(import.c:65:import_set_state_nolock()) ffff99cbe5718800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941128.516182:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+5:3648:x1875840102278144:12345-0@lo:250:mount.lustre.0 Request processed in 240us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941128.516190:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941128.516234:0:3648:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788941128.516242:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.142@tcp: connect to target with instance 0 00000100:00080000:1.0:1788941128.516249:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788941128.516252:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788941128.516256:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbe5718000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788941128.516258:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788941128.516265:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788941128.516269:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3648:1875840102278144:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788941128.541226:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941128.541446:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788941128.541452:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788941128.543271:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788941128.543281:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788941128.543582:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788941128.543588:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788941128.544543:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941128.544741:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788941128.544747:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788941128.545321:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788941128.545329:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788941128.578377:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788941128.578618:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788941128.578626:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788941128.579992:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788941128.580005:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788941128.580467:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941128.580658:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788941128.580664:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788941128.581210:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788941128.581217:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788941128.581664:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941128.581812:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788941128.581817:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788941128.582601:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788941128.582607:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788941128.583211:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941128.583369:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788941128.583374:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788941128.584564:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788941128.584576:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788941128.601445:0:22675:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788941128.601739:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788941128.601746:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788941128.603560:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788941128.603573:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788941128.604375:0:22675:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788941128.604385:0:22675:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788941128.605275:0:22675:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788941128.605307:0:22675:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788941128.605316:0:22675:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788941128.605441:0:22675:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788941128.605483:0:22675:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788941128.605488:0:22675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788941128.605490:0:22675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788941128.605494:0:22675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941128.605495:0:22675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941128.605497:0:22675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941128.605498:0:22675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941128.605499:0:22675:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788941128.605501:0:22675:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788941128.605502:0:22675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941128.605504:0:22675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788941128.605506:0:22675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788941128.605508:0:22675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788941128.605509:0:22675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788941128.605510:0:22675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941128.605511:0:22675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941128.605512:0:22675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941128.605514:0:22675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941128.605515:0:22675:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788941128.605516:0:22675:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788941128.605516:0:22675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941128.605517:0:22675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788941128.605545:0:22675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788941128.605567:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788941128.605639:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.605683:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc48abd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941128.605731:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102278272 00000100:00100000:1.0:1788941128.605738:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102278272 00000100:00100000:1.0:1788941128.605929:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941128.605942:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+5:22675:x1875840102278272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788941128.606219:0:22691:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788941128.606223:0:22691:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788941128.606226:0:22691:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788941128.606471:0:22712:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788941128.607145:0:22691:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788941128.608533:0:22713:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788941128.608540:0:22713:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788941128.608544:0:22713:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788941128.608547:0:22713:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788941128.608704:0:22713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788941128.609118:0:22691:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788941128.609129:0:22691:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788941128.613640:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+5:22675:x1875840102278272:12345-0@lo:253:mount.lustre.0 Request processed in 7692us (7991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941128.613658:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941128.613754:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278272:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788941128.613830:0:22675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788941128.614141:0:22675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788941128.614142:0:22675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788941128.614144:0:22675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941128.614145:0:22675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941128.614147:0:22675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941128.614148:0:22675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941128.614149:0:22675:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788941128.614151:0:22675:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788941128.614153:0:22675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941128.614154:0:22675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788941128.614174:0:22675:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cbe5775000 from lustre-MDT0000 10000000:01000000:3.0:1788941128.614215:0:22675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788941128.614219:0:22675:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788941128.614224:0:22675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99cbf93a3380 10000000:01000000:3.0:1788941128.614228:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788941128.614238:0:22675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99cbf93a3380 from 1 10000000:01000000:3.0:1788941128.614243:0:22675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788941128.614294:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.614307:0:22675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.614318:0:22675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941128.614342:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941128.614389:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.614430:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc48ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941128.614495:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102278400 00000100:00100000:1.0:1788941128.614502:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102278400 00000100:00100000:1.0:1788941128.614545:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941128.614554:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+5:22675:x1875840102278400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941128.614567:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941128.614582:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac19a5200/0x24b6539075b3eb95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3eb8e expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.614605:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac19a5200/0x24b6539075b3eb95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3eb8e expref: 6 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.614616:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac19a5200/0x24b6539075b3eb95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3eb8e expref: 6 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.614625:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac19a5200, rc 0) 00000100:00100000:1.0:1788941128.614746:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+6:22675:x1875840102278400:12345-0@lo:101:mount.lustre.0 Request processed in 192us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941128.614774:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788941128.615001:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941128.615017:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.615027:0:22675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941128.615079:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941128.615105:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.615170:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc48ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941128.615210:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102278528 00000100:00100000:1.0:1788941128.615215:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102278528 00000100:00100000:1.0:1788941128.615293:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941128.615301:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+6:22675:x1875840102278528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941128.615379:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+6:22675:x1875840102278528:12345-0@lo:501:mount.lustre.0 Request processed in 78us (272us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788941128.615387:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788941128.615446:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278528:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788941128.615480:0:22675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788941128.615503:0:22675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.615512:0:22675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941128.615519:0:22675:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cbe5775000 10000000:01000000:3.0:1788941128.615523:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788941128.615527:0:22675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cbe5775000 10000000:01000000:3.0:1788941128.615529:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788941128.615532:0:22675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99cbe5775000 from 1 10000000:01000000:3.0:1788941128.615534:0:22675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788941128.615550:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3eb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.615557:0:22675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3eb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.615564:0:22675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3eb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941128.615574:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941128.615597:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.615703:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc48ab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.615771:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102278656 00000100:00100000:0.0:1788941128.615776:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102278656 00000100:00100000:0.0:1788941128.615798:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788941128.615811:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+6:22675:x1875840102278656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941128.615819:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941128.615831:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09bc00/0x24b6539075b3eba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3eb9c expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.615875:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09bc00/0x24b6539075b3eba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3eb9c expref: 7 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.615885:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09bc00/0x24b6539075b3eba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3eb9c expref: 7 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.615892:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09bc00, rc 0) 00000100:00100000:0.0:1788941128.615978:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+7:22675:x1875840102278656:12345-0@lo:101:mount.lustre.0 Request processed in 167us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.615984:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788941128.616197:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941128.616208:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3eb9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eba3 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.616226:0:22675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3eb9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3eba3 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941128.616237:0:22675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788941128.616275:0:22675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3eb9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eba3 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.616283:0:22675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f40800/0x24b6539075b3eb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eba3 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941128.616289:0:22675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788941128.616292:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788941128.616297:0:22675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cbe5775000 10000000:01000000:3.0:1788941128.616299:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788941128.616302:0:22675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788941128.616304:0:22675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788941128.616317:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41400/0x24b6539075b3ebaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.616324:0:22675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f41400/0x24b6539075b3ebaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.616332:0:22675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f41400/0x24b6539075b3ebaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941128.616343:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941128.616366:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.616391:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc48ab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.616440:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102278784 00000100:00100000:0.0:1788941128.616444:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102278784 00000100:00100000:0.0:1788941128.616469:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941128.616475:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+7:22675:x1875840102278784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941128.616481:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941128.616488:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09be00/0x24b6539075b3ebb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ebaa expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.616501:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09be00/0x24b6539075b3ebb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ebaa expref: 8 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.616509:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09be00/0x24b6539075b3ebb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ebaa expref: 8 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.616526:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09be00, rc 0) 00000100:00100000:0.0:1788941128.616556:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+8:22675:x1875840102278784:12345-0@lo:101:mount.lustre.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.616561:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941128.616620:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941128.616629:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f41400/0x24b6539075b3ebaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ebb1 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.616636:0:22675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41400/0x24b6539075b3ebaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ebb1 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941128.616677:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941128.616700:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.616723:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc48ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941128.616781:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102278912 00000100:00100000:1.0:1788941128.616785:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102278912 00000100:00100000:1.0:1788941128.616804:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788941128.616809:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+8:22675:x1875840102278912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941128.616964:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+9:22675:x1875840102278912:12345-0@lo:501:mount.lustre.0 Request processed in 154us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941128.616969:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941128.617081:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102278912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941128.617117:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102279040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941128.617149:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.617171:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc48ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941128.617214:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102279040 00000100:00100000:1.0:1788941128.617218:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102279040 00000100:00100000:1.0:1788941128.617233:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788941128.617238:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+9:22675:x1875840102279040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941128.618207:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+9:22675:x1875840102279040:12345-0@lo:503:mount.lustre.0 Request processed in 963us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941128.618215:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788941128.618411:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102279040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941128.618960:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22714:1875840102279168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941128.619004:0:22714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.619066:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac882a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.619107:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102279168 00000100:00100000:0.0:1788941128.619114:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102279168 00000100:00100000:0.0:1788941128.619177:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788941128.619186:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+9:22714:x1875840102279168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941128.619811:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+9:22714:x1875840102279168:12345-0@lo:502:llog_process_th.0 Request processed in 624us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.619819:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788941128.619931:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22714:1875840102279168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788941128.619959:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941128.619970:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.619973:0:22714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788941128.619978:0:22714:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788941128.619981:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941128.619998:0:22714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cbf93a4d40) 00000020:00000080:1.0:1788941128.620015:0:22714:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788941128.620020:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788941128.620115:0:22714:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788941128.620122:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b6539075b3ebbf 00000020:00000080:1.0:1788941128.620343:0:22714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788941128.620348:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941128.620351:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.620352:0:22714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788941128.620355:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941128.620358:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.620359:0:22714:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788941128.620363:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941128.620370:0:22714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cbf93a0000) 00000020:00000080:1.0:1788941128.620379:0:22714:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788941128.620383:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788941128.620385:0:22714:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788941128.620388:0:22714:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788941128.620393:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788941128.620441:0:22714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbe5775000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788941128.620454:0:22714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cbf93a19c0) 00000020:00000080:1.0:1788941128.620464:0:22714:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788941128.620519:0:22714:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788941128.620528:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b6539075b3ebd4 00000020:00000080:1.0:1788941128.620618:0:22714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788941128.620624:0:22714:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788941128.620634:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x24b6539075b3ebdb 00080000:01000000:1.0:1788941128.620641:0:22714:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788941128.620644:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b6539075b3ebe2 00010000:00010000:3.0:1788941128.671505:0:22714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788941128.672187:0:22714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:3.0:1788941128.672465:0:22714:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788941128.673019:0:22714:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99cac66b4d40) 00000020:00000080:3.0:1788941128.673038:0:22714:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788941128.673478:0:22714:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788941128.673488:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b6539075b3ebf0 00000020:00000080:0.0:1788941128.674265:0:22714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788941128.676524:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x24b6539075b3ebf7 00000020:00000080:0.0:1788941128.678259:0:22714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788941128.678276:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941128.678284:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941128.678287:0:22714:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788941128.678290:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788941128.678294:0:22714:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788941128.678296:0:22714:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788941128.678297:0:22714:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788941128.678299:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788941128.678301:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941128.678303:0:22714:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788941128.678306:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941128.678312:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941128.678313:0:22714:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788941128.678318:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788941128.678367:0:22714:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788941128.678394:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941128.678397:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941128.678399:0:22714:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788941128.678401:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941128.678404:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941128.678406:0:22714:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788941128.678408:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788941128.678414:0:22714:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:00000080:0.0:1788941128.678443:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788941128.678460:0:22714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99cbf48ab380) 00000020:00000080:0.0:1788941128.678477:0:22714:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788941128.678482:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788941128.678540:0:22714:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788941128.678547:0:22714:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788941128.678554:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b6539075b3ec05 00010000:00080000:0.0:1788941128.678590:0:22714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cc01ab8800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:0.0:1788941128.680127:0:22714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788941128.688253:0:22714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788941128.688273:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788941128.688319:0:22714:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788941128.688344:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b6539075b3ec0c 00000100:00080000:3.0:1788941128.688357:0:22714:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941128.688375:0:22714:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cc01ab8800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941128.688413:0:22714:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b84e00 x1875840102279296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941128.688484:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102279296:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788941128.688559:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941128.688647:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102279296 00000100:00100000:2.0:1788941128.688655:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102279296 00000100:00100000:2.0:1788941128.688699:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788941128.688707:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102279296:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788941128.688724:0:22701:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788941128.690891:0:22714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788941128.691023:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941128.691030:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.691033:0:22714:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788941128.691036:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788941128.691039:0:22714:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788941128.691040:0:22714:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941128.691042:0:22714:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941128.691043:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788941128.691046:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.691047:0:22714:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788941128.691049:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788941128.691054:0:22714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788941128.691057:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.691058:0:22714:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788941128.691061:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788941128.691064:0:22714:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788941128.691091:0:22714:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788941128.691093:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941128.691110:0:22714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cac66b19c0) 00000020:00000080:3.0:1788941128.691129:0:22714:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788941128.691133:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788941128.691208:0:22714:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788941128.691214:0:22714:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788941128.691221:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b6539075b3ec1a 00010000:00080000:3.0:1788941128.691251:0:22714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbfc148800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788941128.691502:0:22714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788941128.693668:0:22714:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788941128.693887:0:22714:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788941128.696328:0:22714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941128.696501:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788941128.703328:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:2.0:1788941128.704312:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102279296:12345-0@lo:38:llog_process_th.0 Request processed in 15598us (15746us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788941128.704327:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788941128.704445:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941128.704451:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788941128.704455:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102279296:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788941128.704587:0:22720:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788941128.704593:0:22720:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788941128.705673:0:22714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788941128.705688:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788941128.705734:0:22714:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788941128.705769:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b6539075b3ec21 00000100:00080000:3.0:1788941128.705780:0:22714:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941128.705791:0:22714:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cbfc148800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941128.705830:0:22714:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b85f80 x1875840102279424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941128.706132:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102279424:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788941128.706189:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102279424 offset 0 length 520: 4 00000100:00080000:3.0:1788941128.706244:0:22714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788941128.706305:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941128.706309:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.706311:0:22714:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788941128.706315:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788941128.706318:0:22714:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788941128.706319:0:22714:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941128.706321:0:22714:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941128.706323:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788941128.706325:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.706326:0:22714:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788941128.706328:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788941128.706333:0:22714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788941128.706336:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.706337:0:22714:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788941128.706340:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788941128.706343:0:22714:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788941128.706366:0:22714:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788941128.706368:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941128.706391:0:22714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cac66b0000) 00000020:00000080:3.0:1788941128.706404:0:22714:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788941128.706408:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788941128.706465:0:22714:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788941128.706471:0:22714:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788941128.706478:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b6539075b3ec2f 00010000:00080000:3.0:1788941128.706520:0:22714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbfea41000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788941128.706746:0:22714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788941128.706812:0:22714:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788941128.706828:0:22714:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788941128.709343:0:22714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941128.709528:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788941128.709648:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788941128.711187:0:22722:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788941128.711194:0:22722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788941128.711928:0:22714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788941128.711940:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788941128.711977:0:22714:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788941128.711999:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b6539075b3ec36 00000100:00080000:3.0:1788941128.712010:0:22714:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941128.712027:0:22714:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbfea41000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941128.712066:0:22714:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b85180 x1875840102279552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941128.712089:0:22714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788941128.712142:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941128.712146:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.712147:0:22714:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788941128.712150:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941128.712154:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.712155:0:22714:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788941128.712157:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788941128.712165:0:22714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788941128.712168:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941128.712170:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.712172:0:22714:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788941128.712174:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941128.712177:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.712178:0:22714:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788941128.712181:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788941128.712218:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22714:1875840102279680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788941128.712298:0:22714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.712328:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc12ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.712555:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102279552:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788941128.712583:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102279552 offset 0 length 520: 4 00000100:00100000:1.0:1788941128.712673:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102279680 00000100:00100000:1.0:1788941128.712681:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102279680 00000100:00100000:1.0:1788941128.712719:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941128.712729:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+9:22714:x1875840102279680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941128.712887:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+9:22714:x1875840102279680:12345-0@lo:502:llog_process_th.0 Request processed in 159us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941128.712895:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788941128.713074:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22714:1875840102279680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788941128.713100:0:22714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941128.713105:0:22714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941128.713107:0:22714:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788941128.713110:0:22714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788941128.713251:0:22675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788941128.713273:0:22675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788941128.713321:0:22675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41400/0x24b6539075b3ebaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ebb1 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.713334:0:22675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f41400/0x24b6539075b3ebaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ebb1 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941128.713342:0:22675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cbe5775000 from 1 10000000:01000000:1.0:1788941128.713344:0:22675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788941128.713371:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.713378:0:22675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.713400:0:22675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941128.713412:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102279808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788941128.713440:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.713468:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.713511:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102279808 00000100:00100000:0.0:1788941128.713516:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102279808 00000100:00100000:0.0:1788941128.713543:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788941128.713550:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+9:22675:x1875840102279808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941128.713568:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941128.713580:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ec3d expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.713601:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 10 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.713611:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 10 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.713619:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09b000, rc 0) 00000100:00100000:0.0:1788941128.713644:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+10:22675:x1875840102279808:12345-0@lo:101:mount.lustre.0 Request processed in 95us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.713651:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941128.713715:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102279808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941128.713728:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.713737:0:22675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941128.714487:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102279936:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788941128.714525:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.714545:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941128.714561:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102279936 00000100:00100000:1.0:1788941128.714566:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102279936 00000100:00100000:1.0:1788941128.714592:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941128.714598:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+10:22675:x1875840102279936:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788941128.714612:0:22691:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788941128.714618:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788941128.714675:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+10:22675:x1875840102279936:12345-0@lo:256:mount.lustre.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941128.714681:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941128.714714:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102279936:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788941128.715283:0:22675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788941128.715593:0:22675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.715606:0:22675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941128.715613:0:22675:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cbe5775000 from 1 10000000:01000000:1.0:1788941128.715616:0:22675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788941128.715645:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.715653:0:22675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.715660:0:22675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941128.715675:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788941128.715708:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.715739:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941128.715860:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102280064 00000100:00100000:2.0:1788941128.715877:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102280064 00000100:00100000:2.0:1788941128.715920:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788941128.715928:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+10:22675:x1875840102280064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941128.715939:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941128.715955:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ec4b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941128.715978:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 11 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941128.715989:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 11 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941128.715997:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4000, rc 0) 00000100:00100000:2.0:1788941128.716037:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22675:x1875840102280064:12345-0@lo:101:mount.lustre.0 Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941128.716055:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941128.716201:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941128.716213:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.716222:0:22675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941128.716276:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941128.716304:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.716320:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.716363:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102280192 00000100:00100000:0.0:1788941128.716367:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102280192 00000100:00100000:0.0:1788941128.716396:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788941128.716402:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22675:x1875840102280192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941128.716543:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22675:x1875840102280192:12345-0@lo:501:mount.lustre.0 Request processed in 141us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.716550:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788941128.716632:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941128.716659:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941128.716695:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.716715:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.716767:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102280320 00000100:00100000:0.0:1788941128.716771:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102280320 00000100:00100000:0.0:1788941128.716797:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788941128.716803:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22675:x1875840102280320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941128.716992:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22675:x1875840102280320:12345-0@lo:503:mount.lustre.0 Request processed in 188us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.717008:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788941128.717224:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941128.717543:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22724:1875840102280448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941128.717573:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.717629:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57baa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788941128.717656:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102280448 00000100:00100000:2.0:1788941128.717660:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102280448 00000100:00100000:2.0:1788941128.717726:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788941128.717734:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22724:x1875840102280448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788941128.718588:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22724:x1875840102280448:12345-0@lo:502:llog_process_th.0 Request processed in 851us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941128.718596:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788941128.718682:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22724:1875840102280448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788941128.718712:0:22724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941128.718723:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.718726:0:22724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788941128.718734:0:22724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbe5775000 00000020:00000080:1.0:1788941128.718737:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788941128.718746:0:22724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941128.718749:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.718750:0:22724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788941128.718752:0:22724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941128.718755:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.718756:0:22724:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788941128.718769:0:22724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbe5775000 00000020:00000080:1.0:1788941128.718771:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788941128.718858:0:22724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941128.718871:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.718873:0:22724:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788941128.718876:0:22724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941128.718878:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.718880:0:22724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788941128.718891:0:22724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cbe5775000 00000020:00000080:1.0:1788941128.718893:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788941128.718913:0:22724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941128.718915:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.718917:0:22724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788941128.718919:0:22724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941128.718922:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.718923:0:22724:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788941128.718926:0:22724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cbe5775000 00000020:00000080:1.0:1788941128.718927:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788941128.718970:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22724:1875840102280576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941128.719011:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.723425:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57baa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.723518:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102280576 00000100:00100000:0.0:1788941128.723528:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102280576 00000100:00100000:0.0:1788941128.723580:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788941128.723590:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22724:x1875840102280576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941128.723789:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22724:x1875840102280576:12345-0@lo:502:llog_process_th.0 Request processed in 201us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.723799:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788941128.726312:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22724:1875840102280576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788941128.726357:0:22724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941128.726365:0:22724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941128.726367:0:22724:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788941128.726372:0:22724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788941128.726562:0:22675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788941128.726584:0:22675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788941128.726607:0:22675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941128.726621:0:22675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941128.726674:0:22675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788941128.726677:0:22675:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cbe5775000 10000000:01000000:2.0:1788941128.726680:0:22675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cbe5775000 10000000:01000000:2.0:1788941128.726684:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788941128.726691:0:22675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cbe5775000 from 1 10000000:01000000:2.0:1788941128.726694:0:22675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788941128.726727:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5600/0x24b6539075b3ec59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941128.726736:0:22675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5600/0x24b6539075b3ec59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941128.726753:0:22675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5600/0x24b6539075b3ec59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941128.726784:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788941128.726876:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941128.726914:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.730699:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102280704 00000100:00100000:0.0:1788941128.730713:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102280704 00000100:00100000:0.0:1788941128.730890:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788941128.730900:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22675:x1875840102280704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941128.730919:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941128.730940:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09a000/0x24b6539075b3ec60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ec59 expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.730972:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09a000/0x24b6539075b3ec60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ec59 expref: 12 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.730985:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09a000/0x24b6539075b3ec60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ec59 expref: 12 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941128.730995:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09a000, rc 0) 00000100:00100000:0.0:1788941128.731083:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22675:x1875840102280704:12345-0@lo:101:mount.lustre.0 Request processed in 185us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.731090:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788941128.731582:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941128.731604:0:22675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5600/0x24b6539075b3ec59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec60 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941128.731615:0:22675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5600/0x24b6539075b3ec59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ec60 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941128.731694:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941128.731729:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941128.731855:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102280832 00000100:00100000:0.0:1788941128.731876:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102280832 00000100:00100000:0.0:1788941128.731899:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788941128.731906:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22675:x1875840102280832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941128.732026:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22675:x1875840102280832:12345-0@lo:501:mount.lustre.0 Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.732033:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788941128.734121:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788941128.734157:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941128.734205:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788941128.734264:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941128.734296:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788941128.734345:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102280960 00000100:00100000:0.0:1788941128.734351:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102280960 00000100:00100000:0.0:1788941128.734397:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788941128.734406:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22675:x1875840102280960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941128.734506:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22675:x1875840102280960:12345-0@lo:503:mount.lustre.0 Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941128.734513:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788941128.734588:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102280960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941128.734973:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22729:1875840102281088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941128.735010:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941128.735033:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfc0a70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941128.735883:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102281088 00000100:00100000:2.0:1788941128.735892:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102281088 00000100:00100000:2.0:1788941128.735927:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788941128.735934:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22729:x1875840102281088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788941128.736041:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22729:x1875840102281088:12345-0@lo:502:llog_process_th.0 Request processed in 107us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941128.736047:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788941128.736932:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22729:1875840102281088:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788941128.737001:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788941128.737180:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99cbf48acd40) 00000020:00000080:0.0:1788941128.737201:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788941128.737301:0:22729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbe5775000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788941128.737305:0:22729:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbe5775000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788941128.737307:0:22729:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbe5775000 4 00010000:00080000:0.0:1788941128.737342:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbfed28800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:0.0:1788941128.742053:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788941128.744059:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788941128.744108:0:22729:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788941128.744130:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x24b6539075b3ec6e 00000100:00080000:0.0:1788941128.744143:0:22729:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788941128.744155:0:22729:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cbfed28800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788941128.744206:0:22729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfeb97100 x1875840102281216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941128.744252:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875840102281216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941128.744325:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941128.744394:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102281216 00000100:00100000:0.0:1788941128.744400:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102281216 00000100:00100000:0.0:1788941128.744427:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788941128.744434:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875840102281216:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941128.744480:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875840102281216:12345-0@lo:38:llog_process_th.0 Request processed in 45us (155us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788941128.744487:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788941128.744521:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788941128.744530:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfed28800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941128.744544:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788941128.744549:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875840102281216:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788941128.744581:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788941128.756917:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22729:1875840102281344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941128.757004:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941128.757055:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfc0a7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788941128.758384:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102281344 00000100:00100000:3.0:1788941128.758397:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102281344 00000100:00100000:3.0:1788941128.758445:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788941128.758454:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22729:x1875840102281344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788941128.758851:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22729:x1875840102281344:12345-0@lo:502:llog_process_th.0 Request processed in 397us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941128.758870:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788941128.764139:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22729:1875840102281344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941128.764224:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22729:1875840102281472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941128.764291:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.764377:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57ba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941128.766956:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102281472 00000100:00100000:3.0:1788941128.766975:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102281472 00000100:00100000:3.0:1788941128.767071:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788941128.767082:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22729:x1875840102281472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788941128.767243:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22729:x1875840102281472:12345-0@lo:502:llog_process_th.0 Request processed in 163us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941128.767259:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788941128.767341:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22729:1875840102281472:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788941128.767381:0:22729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788941128.769197:0:22675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788941128.769231:0:22675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788941128.769284:0:22675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5600/0x24b6539075b3ec59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec60 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941128.769297:0:22675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5600/0x24b6539075b3ec59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec60 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788941128.769344:0:22675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788941128.769346:0:22675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788941128.769348:0:22675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941128.769349:0:22675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941128.769350:0:22675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941128.769352:0:22675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941128.769353:0:22675:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788941128.769355:0:22675:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788941128.769356:0:22675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941128.769358:0:22675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788941128.769361:0:22675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788941128.769364:0:22675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788941128.769365:0:22675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788941128.769366:0:22675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941128.769367:0:22675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941128.769369:0:22675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941128.769370:0:22675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941128.769371:0:22675:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788941128.769372:0:22675:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788941128.769373:0:22675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941128.769374:0:22675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788941128.769399:0:22675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788941128.769420:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102281600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788941128.769488:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941128.769523:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac68f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788941128.771952:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102281600 00000100:00100000:3.0:1788941128.771965:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102281600 00000100:00100000:3.0:1788941128.772096:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788941128.772108:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22675:x1875840102281600:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788941128.772143:0:22689:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788941128.772159:0:22689:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788941128.774433:0:22689:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788941128.774446:0:22689:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788941128.774460:0:22712:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788941128.774465:0:22712:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788941128.774492:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.774511:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 12 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.774520:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.774563:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 12 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.774578:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 12 pid: 22689 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941128.774593:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102281728:0@lo:104: 00000100:00100000:3.0:1788941128.774665:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941128.774708:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac882a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788941128.774748:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102281728 00000100:00100000:3.0:1788941128.774773:0:22679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102281728 00000100:00100000:3.0:1788941128.774812:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788941128.774820:0:22679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:22712:x1875840102281728:12345-0@lo:104: 00010000:00010000:3.0:1788941128.774850:0:22679:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941128.774911:0:22679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788941128.774917:0:22679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:22712:x1875840102281728:12345-0@lo:104: Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941128.774924:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788941128.774962:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102281728:0@lo:104: 00010000:00010000:3.0:1788941128.774983:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.776933:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941128.776947:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.776972:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5000 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941128.776977:0:22685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.776987:0:22685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941128.776995:0:22685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941128.777001:0:22685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788941128.777046:0:22685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777051:0:22685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941128.777076:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777083:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac19a5000/0x24b6539075b3ec3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec44 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777097:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941128.777099:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941128.777101:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941128.777253:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788941128.777270:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3650:1875840102281856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941128.777326:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941128.777381:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102281856 00000100:00100000:1.0:1788941128.777388:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102281856 00010000:00010000:1.0:1788941128.777416:0:22681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 13 pid: 22689 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941128.777449:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941128.777456:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+13:3650:x1875840102281856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941128.777469:0:22681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941128.777474:0:22681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 13 pid: 22689 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777486:0:22681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 13 pid: 22689 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777500:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfc09b000/0x24b6539075b3ec44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ec3d expref: 13 pid: 22689 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777515:0:22681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777524:0:22681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788941128.777540:0:22681:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003076105s 00010000:00010000:1.0:1788941128.777546:0:22681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777553:0:22681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777559:0:22681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777565:0:22681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777576:0:22681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40000 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941128.777581:0:22681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777589:0:22681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777605:0:22681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777615:0:22681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941128.777648:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:3650:x1875840102281856:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941128.777656:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788941128.777679:0:22712:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777687:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941128.777694:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ec75 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941128.777753:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3650:1875840102281856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941128.778306:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22675:x1875840102281600:12345-0@lo:253:mount.lustre.0 Request processed in 6200us (8816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941128.778315:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788941128.778449:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22675:1875840102281600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788941128.778461:0:22675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788941128.778465:0:22675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788941128.778467:0:22675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788941128.778469:0:22675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941128.778471:0:22675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941128.778472:0:22675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941128.778474:0:22675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941128.778475:0:22675:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788941128.778477:0:22675:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788941128.778479:0:22675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941128.778480:0:22675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788941128.778490:0:22675:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1788941128.796824:0:22675:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1788941128.797547:0:22675:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788941128.797792:0:22737:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788941128.798298:0:22675:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788941128.798566:0:22737:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941128.800764:0:22737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788941128.800899:0:22737:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1788941128.801391:0:22738:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99cac8594000 x1875840102281984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941128.801405:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00000040:01000000:0.0:1788941128.801824:0:22675:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788941128.801905:0:22675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788941128.802679:0:22675:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788941128.802690:0:22675:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788941128.802733:0:22675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788941128.803970:0:22675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788941128.804662:0:22675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788941128.804692:0:22675:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:3.0:1788941128.805149:0:22736:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1788941128.805156:0:22736:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:0.0:1788941128.805748:0:22675:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788941128.807076:0:22675:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788941128.808722:0:22675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788941128.810621:0:22675:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788941128.810668:0:22675:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f201c4b988 00100000:10000000:0.0:1788941128.810676:0:22675:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788941128.811685:0:22675:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788941128.811700:0:22675:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788941128.811719:0:22675:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788941128.811745:0:22675:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788941128.813037:0:22675:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788941128.813242:0:22675:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788941129.540450:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788941129.804588:0:22731:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788941129.804598:0:22731:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788941129.810183:0:22731:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788941129.810201:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788941129.864910:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 10000000:01000000:1.0:1788941130.052671:0:22693:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788941130.052680:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cbe5775000 from 11 10000000:01000000:1.0:1788941130.052686:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788941130.052751:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941130.052764:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941130.052775:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941130.052801:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102282112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788941130.052908:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941130.052956:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1788941130.053048:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102282112 00000100:00100000:0.0:1788941130.053058:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102282112 00000100:00100000:0.0:1788941130.053125:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788941130.053136:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+11:22693:x1875840102282112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941130.053152:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941130.053169:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ec7c expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941130.053193:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 12 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941130.053212:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 12 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941130.053221:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09b600, rc 0) 00000100:00100000:0.0:1788941130.053264:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22693:x1875840102282112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941130.053270:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788941130.053803:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102282112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788941130.053820:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941130.053830:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941130.053953:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102282240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788941130.053991:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941130.054025:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1788941130.054088:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102282240 00000100:00100000:3.0:1788941130.054094:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102282240 00000100:00100000:3.0:1788941130.054127:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788941130.054134:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22693:x1875840102282240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788941130.054150:0:22689:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788941130.054166:0:22689:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788941130.054169:0:22689:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788941130.054248:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:22693:x1875840102282240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941130.054259:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788941130.054462:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102282240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788941130.054505:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788941130.054512:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941130.054524:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941130.564455:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788941130.826102:0:22731:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788941130.826120:0:22731:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788941130.826525:0:22731:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788941130.826577:0:22731:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788941130.826808:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1788941130.883986:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:3.0:1788941131.591662:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941131.907922:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:3.0:1788941132.612786:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941132.935385:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788941133.644163:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941133.956421:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00000001:02000400:2.0:1788941133.958023:0:22980:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788941134.222008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788941134.222017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788941134.222021:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941134.222032:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 737 00000100:00080000:2.0:1788941134.222039:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788941134.222054:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cc01ab8800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941134.222084:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfea7ce00 x1875840102282496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941134.222103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941134.222107:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941134.222110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941134.222113:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941134.222116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788941134.222119:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788941134.222121:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cbfed28800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941134.222128:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cbfed28800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941134.222140:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfea7ca80 x1875840102282624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941134.222178:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788941134.222194:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102282368:0@lo:400:kworker.0 00000100:00100000:2.0:1788941134.222277:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941134.222336:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102282496:0@lo:38:kworker.0 00000100:00100000:2.0:1788941134.222370:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941134.222399:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875840102282624:0@lo:38:kworker.0 00000100:00100000:2.0:1788941134.222427:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941134.222459:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102282368 00000100:00100000:2.0:1788941134.222466:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102282368 00000100:00100000:2.0:1788941134.222509:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788941134.222518:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:3649:x1875840102282368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941134.222564:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:3649:x1875840102282368:12345-0@lo:400:kworker.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941134.222577:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788941134.222626:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102282368:0@lo:400:kworker.0 00000100:00100000:3.0:1788941134.223095:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102282624 00000100:00100000:3.0:1788941134.223101:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102282624 00000100:00100000:3.0:1788941134.223128:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941134.223134:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875840102282624:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788941134.223157:0:22698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:3.0:1788941134.223192:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x24b6539075b3ec8a 00000004:00100000:3.0:1788941134.223207:0:22698:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788941134.223597:0:22698:0:(import.c:65:import_set_state_nolock()) ffff99cbfd8a9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788941134.223659:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875840102282624:12345-0@lo:38:kworker.0 Request processed in 518us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941134.223668:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788941134.223794:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cbfea7ca80 x1875840102282624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941134.223809:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788941134.223816:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788941134.223821:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788941134.223824:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfed28800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788941134.223830:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875840102282624:0@lo:38:kworker.0 00000100:00100000:0.0:1788941134.224217:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102282496 00000100:00100000:0.0:1788941134.224224:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102282496 00000100:00100000:0.0:1788941134.224255:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788941134.224326:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875840102282496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788941134.224340:0:22702:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788941134.224483:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875840102282496:12345-0@lo:38:kworker.0 Request processed in 220us (2111us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788941134.224490:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788941134.224560:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941134.224565:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788941134.224569:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102282496:0@lo:38:kworker.0 00010000:00010000:1.0:1788941134.662958:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941134.980296:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00000020:00000004:3.0:1788941135.023251:0:23032:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788941135.023821:0:23032:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788941135.685461:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788941135.810027:0:23083:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941135.810234:0:23083:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788941136.004122:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788941136.712068:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941137.027947:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788941137.740318:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941138.069066:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00000100:00100000:2.0:1788941138.313978:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941128/real 1788941128] req@ffff99cc01b85180 x1875840102279552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941138.314008:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cc01b85180 x1875840102279552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941138.314020:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941128/real 1788941128] req@ffff99cc01b85f80 x1875840102279424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941138.314030:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cc01b85f80 x1875840102279424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941138.314060:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941138.314093:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788941138.314097:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102279552:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788941138.314105:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfc148800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941138.314111:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788941138.314114:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102279424:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788941138.314595:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788941138.314600:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788941138.314604:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941138.314610:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 742 00000100:00080000:1.0:1788941138.314616:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788941138.314628:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cc01ab8800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941138.314649:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8594380 x1875840102282880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941138.314663:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941138.314667:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788941138.314669:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cbfc148800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941138.314672:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 737 00000100:00080000:1.0:1788941138.314675:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788941138.314680:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cbfc148800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941138.314710:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8596680 x1875840102283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941138.314720:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941138.314723:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788941138.314725:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941138.314728:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 737 00000100:00080000:1.0:1788941138.314731:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788941138.314736:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbfea41000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941138.314746:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8597800 x1875840102283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941138.314884:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875840102283264:0@lo:400:kworker.0 00000100:00100000:2.0:1788941138.314957:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941138.315087:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788941138.315094:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102282752:0@lo:400:kworker.0 00000100:00100000:2.0:1788941138.315122:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941138.315171:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102283264 00000100:00100000:2.0:1788941138.315178:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102283264 00000100:00100000:2.0:1788941138.315220:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788941138.315228:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875840102283264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941138.315281:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875840102283264:12345-0@lo:400:kworker.0 Request processed in 53us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941138.315289:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788941138.315313:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102282752 00000100:00100000:2.0:1788941138.315316:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102282752 00000100:00100000:2.0:1788941138.315342:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788941138.315739:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:3652:x1875840102282752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941138.315780:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:3652:x1875840102282752:12345-0@lo:400:kworker.0 Request processed in 431us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941138.315787:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788941138.315976:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102282752:0@lo:400:kworker.0 00010000:00080000:3.0:1788941138.315999:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cac8594e00 x1875840102283264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941138.316012:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875840102283264:0@lo:400:kworker.0 00000100:00100000:2.0:1788941138.316092:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102282880:0@lo:38:kworker.0 00000100:00100000:2.0:1788941138.316136:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941138.316161:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102283008:0@lo:8:kworker.0 00000400:00000100:2.0:1788941138.316184:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102283008 offset 0 length 520: 4 00000100:00100000:2.0:1788941138.316202:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102283136:0@lo:8:kworker.0 00000400:00000100:2.0:1788941138.316220:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102283136 offset 0 length 520: 4 00000100:00100000:3.0:1788941138.316946:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102282880 00000100:00100000:3.0:1788941138.316954:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102282880 00000100:00100000:3.0:1788941138.316991:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788941138.316998:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875840102282880:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788941138.317021:0:22702:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788941138.317079:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875840102282880:12345-0@lo:38:kworker.0 Request processed in 80us (947us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788941138.317087:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788941138.317966:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941138.317975:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941138.317980:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102282880:0@lo:38:kworker.0 00010000:00010000:1.0:1788941138.756043:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941139.075898:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:3.0:1788941139.790605:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788941140.037757:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788941140.099899:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788941140.807613:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941141.124617:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:3.0:1788941141.828005:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941142.148377:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788941142.852055:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941143.173915:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00000100:00080000:3.0:1788941143.428152:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788941143.428173:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788941143.428178:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941143.428191:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 746 00000100:00080000:3.0:1788941143.428201:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788941143.428221:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cc01ab8800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941143.428253:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b87480 x1875840102283520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941143.428269:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941143.428274:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941143.428277:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941143.428280:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941143.428351:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102283648:0@lo:400:kworker.0 00000100:00100000:1.0:1788941143.428455:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941143.428532:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788941143.428538:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3650:1875840102283392:0@lo:400:kworker.0 00000100:00100000:1.0:1788941143.428573:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941143.428619:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102283520:0@lo:38:kworker.0 00000100:00100000:1.0:1788941143.428653:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941143.428694:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102283392 00000100:00100000:1.0:1788941143.428705:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102283392 00000100:00100000:1.0:1788941143.428782:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788941143.428793:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:3650:x1875840102283392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941143.428893:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:3650:x1875840102283392:12345-0@lo:400:kworker.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941143.428902:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788941143.428953:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102283520 00000100:00100000:1.0:1788941143.428956:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102283520 00000100:00100000:1.0:1788941143.428978:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941143.428983:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102283520:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788941143.429007:0:22701:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788941143.429058:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102283520:12345-0@lo:38:kworker.0 Request processed in 73us (404us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788941143.429064:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941143.429105:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3650:1875840102283392:0@lo:400:kworker.0 00000100:00080000:1.0:1788941143.429147:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941143.429152:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941143.429155:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102283520:0@lo:38:kworker.0 00000100:00100000:3.0:1788941143.429255:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102283648 00000100:00100000:3.0:1788941143.429259:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102283648 00000100:00100000:3.0:1788941143.429295:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941143.429303:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102283648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941143.429347:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102283648:12345-0@lo:400:kworker.0 Request processed in 46us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941143.429366:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788941143.429754:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cc01b84380 x1875840102283648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941143.429767:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102283648:0@lo:400:kworker.0 00010000:00010000:3.0:1788941143.880050:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788941144.000681:0:23428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788941144.000684:0:23428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788941144.000685:0:23428:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788941144.000901:0:23428:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cac84eb800 00000020:01000004:0.0:1788941144.000917:0:23428:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788941144.000927:0:23428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788941144.000940:0:23428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff99cbf48a99c0) 00000020:00000080:0.0:1788941144.000955:0:23428:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788941144.105611:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.106628:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788941144.113456:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788941144.113870:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788941144.114242:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788941144.114414:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788941144.114586:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788941144.114923:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788941144.115265:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788941144.115436:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788941144.115574:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788941144.115913:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788941144.116224:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788941144.116465:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788941144.117399:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.118168:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.118713:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.119027:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.119261:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.119483:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.119709:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.120162:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.120373:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.120632:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.121016:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.121327:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.121504:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.121770:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.122200:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.122408:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.122567:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.123171:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.123345:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.123531:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.123722:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.124120:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.124374:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.124569:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.124966:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.125244:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.125456:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.125787:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.126191:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.126411:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788941144.126551:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788941144.126958:0:23428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00080000:01000000:0.0:1788941144.127736:0:23428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788941144.127977:0:23428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788941144.127992:0:23428:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788941144.128001:0:23428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b6539075b3ec98 00000020:01000004:0.0:1788941144.128006:0:23428:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788941144.128024:0:23428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788941144.128027:0:23428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788941144.128031:0:23428:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788941144.128053:0:23428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788941144.128056:0:23428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788941144.135808:0:23428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788941144.136118:0:23428:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.142@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788941144.136123:0:23428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788941144.136125:0:23428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788941144.136127:0:23428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941144.136132:0:23428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941144.136134:0:23428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941144.136135:0:23428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941144.136137:0:23428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788941144.136138:0:23428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941144.136139:0:23428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788941144.136143:0:23428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788941144.136145:0:23428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788941144.136146:0:23428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788941144.136147:0:23428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941144.136148:0:23428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941144.136149:0:23428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941144.136150:0:23428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941144.136151:0:23428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788941144.136152:0:23428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941144.136152:0:23428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788941144.136411:0:23428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788941144.136436:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102283776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788941144.136557:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.136649:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbccb10600 going to sleep for 11 seconds 00000100:00100000:2.0:1788941144.136788:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102283776 00000100:00100000:2.0:1788941144.136795:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102283776 00000100:00100000:2.0:1788941144.137041:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788941144.137049:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:23428:x1875840102283776:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788941144.137092:0:22691:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788941144.137095:0:22691:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788941144.137104:0:22691:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788941144.137515:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:23428:x1875840102283776:12345-0@lo:253:mount.lustre.0 Request processed in 465us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.137523:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788941144.137617:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102283776:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788941144.137628:0:23428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788941144.137631:0:23428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788941144.137632:0:23428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788941144.137634:0:23428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941144.137635:0:23428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941144.137636:0:23428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941144.137637:0:23428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941144.137638:0:23428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788941144.137640:0:23428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941144.137641:0:23428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788941144.137666:0:23428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cac84eb800 from lustre-MDT0001 10000000:01000000:0.0:1788941144.137706:0:23428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788941144.137708:0:23428:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788941144.137715:0:23428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cbf93a3380 local copy 00010000:00010000:0.0:1788941144.137724:0:23428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941144.137862:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102283904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941144.137887:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.138803:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc11caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.139053:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102283904 00000100:00100000:1.0:1788941144.139078:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102283904 00000100:00100000:1.0:1788941144.139136:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788941144.139146:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:23428:x1875840102283904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941144.139246:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:23428:x1875840102283904:12345-0@lo:501:mount.lustre.0 Request processed in 103us (1357us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788941144.139254:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788941144.139381:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102283904:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788941144.139400:0:23428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788941144.139431:0:23428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788941144.139438:0:23428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.139446:0:23428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941144.139472:0:23428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cac84eb800 10000000:01000000:0.0:1788941144.139476:0:23428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788941144.139479:0:23428:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99cbf93a3380 10000000:01000000:0.0:1788941144.139481:0:23428:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788941144.139484:0:23428:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99cbf93a3380 from 1 10000000:01000000:0.0:1788941144.139495:0:23428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788941144.139518:0:23428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b800/0x24b6539075b3ec9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.139523:0:23428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b800/0x24b6539075b3ec9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.139530:0:23428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b800/0x24b6539075b3ec9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941144.139541:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941144.139562:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.139584:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc11caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.139679:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102284032 00000100:00100000:1.0:1788941144.139683:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102284032 00000100:00100000:1.0:1788941144.139711:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788941144.139716:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+12:23428:x1875840102284032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941144.139723:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941144.139736:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac19a5a00/0x24b6539075b3eca6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ec9f expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.139763:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac19a5a00/0x24b6539075b3eca6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ec9f expref: 13 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.139771:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac19a5a00/0x24b6539075b3eca6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ec9f expref: 13 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.139778:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac19a5a00, rc 0) 00000100:00100000:1.0:1788941144.139806:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+13:23428:x1875840102284032:12345-0@lo:101:mount.lustre.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.139809:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788941144.140045:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941144.140054:0:23428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b800/0x24b6539075b3ec9f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eca6 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.140070:0:23428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b800/0x24b6539075b3ec9f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3eca6 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941144.140086:0:23428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788941144.140094:0:23428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b800/0x24b6539075b3ec9f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eca6 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.140102:0:23428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b800/0x24b6539075b3ec9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eca6 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941144.140109:0:23428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cac84eb800 10000000:01000000:0.0:1788941144.140112:0:23428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788941144.140116:0:23428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99cac84eb800 from 1 10000000:01000000:0.0:1788941144.140118:0:23428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788941144.140132:0:23428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09a600/0x24b6539075b3ecad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.140139:0:23428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbfc09a600/0x24b6539075b3ecad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.140147:0:23428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbfc09a600/0x24b6539075b3ecad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941144.140168:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941144.140187:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.140197:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc11caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.140481:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102284160 00000100:00100000:1.0:1788941144.140498:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102284160 00000100:00100000:1.0:1788941144.140521:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788941144.140529:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+13:23428:x1875840102284160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941144.140537:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941144.140549:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac19a4400/0x24b6539075b3ecb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ecad expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.140565:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac19a4400/0x24b6539075b3ecb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ecad expref: 14 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.140574:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac19a4400/0x24b6539075b3ecb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ecad expref: 14 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.140580:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac19a4400, rc 0) 00000100:00100000:1.0:1788941144.140626:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+14:23428:x1875840102284160:12345-0@lo:101:mount.lustre.0 Request processed in 98us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.140631:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788941144.140879:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941144.140891:0:23428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbfc09a600/0x24b6539075b3ecad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ecb4 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.140896:0:23428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09a600/0x24b6539075b3ecad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ecb4 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941144.140911:0:23428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788941144.140920:0:23428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09a600/0x24b6539075b3ecad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ecb4 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.140924:0:23428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbfc09a600/0x24b6539075b3ecad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ecb4 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941144.140928:0:23428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788941144.140930:0:23428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788941144.140934:0:23428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cac84eb800 10000000:01000000:0.0:1788941144.140936:0:23428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788941144.140938:0:23428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788941144.140939:0:23428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788941144.141140:0:23428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b000/0x24b6539075b3ecbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.141149:0:23428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b000/0x24b6539075b3ecbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.141155:0:23428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b000/0x24b6539075b3ecbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941144.141165:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941144.141185:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.141202:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc11caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788941144.141282:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102284288 00000100:00100000:2.0:1788941144.141286:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102284288 00000100:00100000:2.0:1788941144.141308:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788941144.141315:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+14:23428:x1875840102284288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941144.141323:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941144.141330:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec4800/0x24b6539075b3ecc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ecbb expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941144.141340:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec4800/0x24b6539075b3ecc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ecbb expref: 15 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941144.141346:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec4800/0x24b6539075b3ecc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ecbb expref: 15 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941144.141358:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4800, rc 0) 00000100:00100000:2.0:1788941144.141391:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284288:12345-0@lo:101:mount.lustre.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.141397:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788941144.141431:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941144.141442:0:23428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b000/0x24b6539075b3ecbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ecc2 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941144.141450:0:23428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b000/0x24b6539075b3ecbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ecc2 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788941144.145485:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788941144.147112:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941144.153290:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788941144.153355:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788941144.153373:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788941144.153387:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788941144.153400:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788941144.153414:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788941144.153427:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788941144.153441:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788941144.153455:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788941144.153469:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788941144.153485:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788941144.153576:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788941144.153611:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788941144.153629:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788941144.153645:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788941144.153657:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788941144.153669:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788941144.153683:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788941144.154299:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788941144.154319:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788941144.154333:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788941144.154345:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788941144.154360:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788941144.154375:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788941144.154388:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788941144.154400:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788941144.154413:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788941144.154427:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788941144.154439:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788941144.154466:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788941144.154478:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788941144.154614:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788941144.154634:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788941144.154649:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788941144.154662:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788941144.154676:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788941144.154687:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788941144.155082:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788941144.155105:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788941144.155120:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788941144.155134:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788941144.155148:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788941144.155161:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788941144.155173:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788941144.155203:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788941144.155208:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788941144.155327:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941144.155398:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941144.155523:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf9048e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788941144.155639:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102284416 00000100:00100000:2.0:1788941144.155650:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102284416 00000100:00100000:2.0:1788941144.155755:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788941144.155767:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941144.156354:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284416:12345-0@lo:501:mount.lustre.0 Request processed in 588us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.156363:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788941144.156441:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941144.156481:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941144.156541:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941144.157244:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf9048e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.157315:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102284544 00000100:00100000:1.0:1788941144.157322:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102284544 00000100:00100000:1.0:1788941144.157357:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788941144.157365:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941144.159884:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284544:12345-0@lo:503:mount.lustre.0 Request processed in 2507us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.159901:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788941144.164298:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284544:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788941144.167281:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788941144.167389:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941144.167474:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941144.168939:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf9048e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.169631:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102284672 00000100:00100000:1.0:1788941144.169642:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102284672 00000100:00100000:1.0:1788941144.169794:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788941144.169805:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941144.171146:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284672:12345-0@lo:502:mount.lustre.0 Request processed in 1335us (3664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.171157:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788941144.171615:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941144.172253:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788941144.172288:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788941144.172305:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788941144.172321:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788941144.172336:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788941144.172349:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788941144.172362:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788941144.172375:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788941144.172388:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788941144.172401:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788941144.172415:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788941144.172428:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788941144.172442:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788941144.172456:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788941144.172470:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788941144.172483:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788941144.172645:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788941144.172661:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788941144.172675:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788941144.172687:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788941144.172943:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788941144.173024:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788941144.173040:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788941144.173058:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788941144.173073:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788941144.173089:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788941144.173105:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788941144.173121:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788941144.173135:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788941144.173149:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788941144.173176:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788941144.173190:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788941144.173203:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788941144.173217:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788941144.173228:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788941144.173238:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788941144.173248:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788941144.173258:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788941144.173268:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788941144.173277:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788941144.173287:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788941144.173306:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788941144.173317:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788941144.173327:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788941144.173376:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941144.173460:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941144.173650:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf9048e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941144.173816:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102284800 00000100:00100000:0.0:1788941144.174113:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102284800 00000100:00100000:1.0:1788941144.174276:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788941144.174287:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941144.174437:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102284800:12345-0@lo:502:mount.lustre.0 Request processed in 152us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.174446:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788941144.174545:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102284800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941144.174619:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1788941144.174629:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788941144.176222:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941144.176238:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.176241:0:23432:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788941144.176247:0:23432:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788941144.176251:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941144.176265:0:23432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff99cbfe823380) 00000020:00000080:3.0:1788941144.176287:0:23432:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788941144.176292:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788941144.176377:0:23432:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788941144.176385:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b6539075b3ecd0 00000020:00000080:3.0:1788941144.176783:0:23432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788941144.176795:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941144.176799:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.176800:0:23432:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788941144.176804:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941144.176808:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.176809:0:23432:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788941144.176812:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941144.176820:0:23432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff99cbfe824d40) 00000020:00000080:3.0:1788941144.176831:0:23432:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788941144.176863:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788941144.176865:0:23432:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788941144.176868:0:23432:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788941144.176874:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788941144.176933:0:23432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cac84eb800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788941144.177024:0:23432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff99cbfe8219c0) 00000020:00000080:3.0:1788941144.177036:0:23432:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788941144.177101:0:23432:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788941144.177107:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b6539075b3ece5 00000020:00000080:3.0:1788941144.177203:0:23432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788941144.177209:0:23432:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788941144.177214:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x24b6539075b3ecec 00080000:01000000:3.0:1788941144.177219:0:23432:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788941144.177222:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b6539075b3ecf3 00000100:00100000:0.0:1788941144.197871:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:2.0:1788941144.306668:0:23432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788941144.307306:0:23432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1788941144.307636:0:23432:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788941144.309607:0:23432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788941144.310439:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941144.310446:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941144.310448:0:23432:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788941144.310450:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941144.310455:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941144.310457:0:23432:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788941144.310458:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788941144.310462:0:23432:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:00000080:0.0:1788941144.310742:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788941144.310758:0:23432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff99cac7aa0000) 00000020:00000080:0.0:1788941144.310776:0:23432:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788941144.310780:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788941144.310891:0:23432:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788941144.310898:0:23432:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788941144.310907:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b6539075b3ed01 00010000:00080000:0.0:1788941144.310943:0:23432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cac5a5a800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:0.0:1788941144.315352:0:23432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788941144.318692:0:23432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788941144.318916:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788941144.318970:0:23432:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788941144.318994:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b6539075b3ed08 00000100:00080000:3.0:1788941144.319005:0:23432:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941144.319017:0:23432:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cac5a5a800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941144.319057:0:23432:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b87b80 x1875840102284928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941144.319082:0:23432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788941144.319123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941144.319128:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941144.319130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941144.319133:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788941144.319198:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941144.319215:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.319217:0:23432:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788941144.319220:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788941144.319223:0:23432:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788941144.319225:0:23432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941144.319226:0:23432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941144.319227:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788941144.319230:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.319231:0:23432:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788941144.319234:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941144.319238:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.319240:0:23432:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788941144.319244:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788941144.319277:0:23432:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788941144.319290:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941144.319293:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.319294:0:23432:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788941144.319297:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788941144.319298:0:23432:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788941144.319300:0:23432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941144.319301:0:23432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941144.319303:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788941144.319305:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.319306:0:23432:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788941144.319308:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788941144.319312:0:23432:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788941144.319320:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.319322:0:23432:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788941144.319325:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788941144.319329:0:23432:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788941144.319353:0:23432:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788941144.319356:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941144.319372:0:23432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99cbfe820000) 00000020:00000080:3.0:1788941144.319384:0:23432:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788941144.319390:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788941144.319469:0:23432:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788941144.319475:0:23432:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788941144.319494:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b6539075b3ed16 00010000:00080000:3.0:1788941144.319528:0:23432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cac5a58800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788941144.322351:0:23432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788941144.322433:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102284928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941144.323305:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1788941144.323969:0:23432:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788941144.324312:0:23432:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788941144.326676:0:23432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941144.327089:0:23432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788941144.327543:0:23432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1788941144.328179:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102284928 00000100:00100000:1.0:1788941144.328190:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102284928 00000100:00100000:1.0:1788941144.328248:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788941144.328257:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102284928:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788941144.328289:0:22701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 752 last 0 00000020:00000080:1.0:1788941144.328323:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b6539075b3ed1d 00000004:00100000:1.0:1788941144.328338:0:22701:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788941144.328350:0:22701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:3.0:1788941144.329180:0:23437:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788941144.329186:0:23437:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788941144.330571:0:23432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788941144.330595:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788941144.330756:0:23432:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788941144.330781:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b6539075b3ed24 00000100:00080000:3.0:1788941144.330791:0:23432:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941144.330802:0:23432:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cac5a58800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941144.336481:0:23432:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b87100 x1875840102285056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941144.336532:0:23432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788941144.336678:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941144.336686:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.336688:0:23432:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788941144.336691:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788941144.336695:0:23432:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000100:00100000:0.0:1788941144.336870:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102285056:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788941144.336937:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102285056 offset 0 length 520: 4 00000020:01000000:3.0:1788941144.337267:0:23432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941144.337273:0:23432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941144.337275:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788941144.337280:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.337282:0:23432:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788941144.337285:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788941144.337291:0:23432:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788941144.337294:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941144.337296:0:23432:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788941144.337299:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788941144.337303:0:23432:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788941144.337324:0:23432:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788941144.337327:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941144.337347:0:23432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99cbfd80cd40) 00000100:00080000:2.0:1788941144.337378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000020:00000080:3.0:1788941144.337380:0:23432:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000100:00080000:2.0:1788941144.337383:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000020:00000080:3.0:1788941144.337386:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:2.0:1788941144.337387:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941144.337392:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 752 00000100:00080000:2.0:1788941144.337402:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788941144.337411:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cc01ab8800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941144.337430:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfea7df80 x1875840102285312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941144.337445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941144.337448:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941144.337451:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941144.337454:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941144.337464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788941144.337467:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788941144.337564:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875840102285440:0@lo:400:kworker.0 00000100:00100000:2.0:1788941144.337620:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941144.337644:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788941144.337650:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102285184:0@lo:400:kworker.0 00000100:00100000:2.0:1788941144.337696:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941144.337731:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102285440 00000100:00100000:2.0:1788941144.337738:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102285440 00000100:00100000:2.0:1788941144.337779:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788941144.337788:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875840102285440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941144.337862:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102285184 00000100:00100000:2.0:1788941144.337866:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102285184 00000100:00100000:2.0:1788941144.337892:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788941144.337899:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:3652:x1875840102285184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941144.337972:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:3652:x1875840102285184:12345-0@lo:400:kworker.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.337985:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000004:00080000:3.0:1788941144.338029:0:23432:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788941144.338038:0:23432:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000100:00100000:2.0:1788941144.338045:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875840102285440:12345-0@lo:400:kworker.0 Request processed in 258us (425us total) trans 0 rc 0/0 00000020:00000080:3.0:1788941144.338047:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b6539075b3ed32 00000100:00100000:2.0:1788941144.338052:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788941144.338071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102285312:0@lo:38:kworker.0 00010000:00080000:3.0:1788941144.338078:0:23432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbfda41800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.142@tcp at head 00000100:00100000:2.0:1788941144.338094:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941144.338126:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788941144.338135:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788941144.338162:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102285184:0@lo:400:kworker.0 00010000:00080000:2.0:1788941144.338175:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cbfea7d180 x1875840102285440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941144.338185:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875840102285440:0@lo:400:kworker.0 00000100:00080000:2.0:1788941144.338344:0:22701:0:(import.c:65:import_set_state_nolock()) ffff99cac7944800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941144.338383:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875840102284928:12345-0@lo:38:llog_process_th.0 Request processed in 10126us (15081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.338390:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788941144.338405:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102285312 00010000:00010000:3.0:1788941144.338406:0:23432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00100000:2.0:1788941144.338409:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102285312 00000100:00100000:2.0:1788941144.338419:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788941144.338424:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102285312:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788941144.338454:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102285312:12345-0@lo:38:kworker.0 Request processed in 30us (359us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788941144.338460:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:01000000:3.0:1788941144.338477:0:23432:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788941144.338480:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941144.338486:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941144.338495:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788941144.338498:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102285312:0@lo:38:kworker.0 00000100:00100000:2.0:1788941144.338515:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941144.338520:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788941144.338527:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788941144.338531:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788941144.338533:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac5a5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788941144.338542:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102284928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788941144.338811:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788941144.338821:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102285568:0@lo:41:osp-pre-0-1.0 00000040:01000000:3.0:1788941144.338853:0:23432:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788941144.338873:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.339036:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102285568 00000100:00100000:0.0:1788941144.339042:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102285568 00000100:00100000:0.0:1788941144.339066:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788941144.339078:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875840102285568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788941144.339102:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788941144.339165:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875840102285568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941144.339171:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788941144.339265:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102285568:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788941144.342077:0:23432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941144.342422:0:23432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788941144.342553:0:23432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788941144.343076:0:23440:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788941144.343081:0:23440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788941144.344158:0:23432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788941144.344301:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788941144.344351:0:23432:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788941144.344382:0:23432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b6539075b3ed39 00000100:00080000:2.0:1788941144.344396:0:23432:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788941144.344409:0:23432:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99cbfda41800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941144.344453:0:23432:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfea7df80 x1875840102285696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941144.344535:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102285696:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788941144.344609:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102285696 offset 0 length 520: 4 00000100:00080000:2.0:1788941144.344667:0:23432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788941144.344775:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941144.344779:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941144.344781:0:23432:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788941144.344784:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941144.344788:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941144.344789:0:23432:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788941144.344792:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788941144.344794:0:23432:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788941144.344796:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941144.344872:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941144.344874:0:23432:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788941144.344878:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941144.344881:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941144.344882:0:23432:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788941144.344886:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788941144.344919:0:23432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941144.344922:0:23432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941144.344923:0:23432:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788941144.344926:0:23432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1788941144.345614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941144.345629:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941144.345632:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941144.345635:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788941144.345659:0:23428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788941144.345756:0:23428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788941144.345813:0:23428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b000/0x24b6539075b3ecbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ecc2 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.345828:0:23428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b000/0x24b6539075b3ecbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ecc2 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941144.345867:0:23428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cac84eb800 from 1 10000000:01000000:3.0:1788941144.345870:0:23428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788941144.345906:0:23428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.345915:0:23428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.345928:0:23428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941144.345949:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102285824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941144.346006:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941144.346041:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfc0dd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788941144.346191:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102285824 00000100:00100000:2.0:1788941144.348307:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102285824 00000100:00100000:2.0:1788941144.348390:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788941144.348400:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+15:23428:x1875840102285824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941144.348419:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941144.348439:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ed40 expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941144.348466:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 16 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941144.348477:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 16 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941144.348487:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec5400, rc 0) 00000100:00100000:2.0:1788941144.348556:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:23428:x1875840102285824:12345-0@lo:101:mount.lustre.0 Request processed in 157us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.348562:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788941144.348704:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102285824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941144.348724:0:23428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.348734:0:23428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941144.349284:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102285952:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788941144.349330:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.349365:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf903eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788941144.349827:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102285952 00000100:00100000:3.0:1788941144.349869:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102285952 00000100:00100000:3.0:1788941144.349914:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788941144.349932:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:23428:x1875840102285952:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788941144.349952:0:22689:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788941144.349967:0:22689:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788941144.349970:0:22689:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788941144.350054:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:23428:x1875840102285952:12345-0@lo:256:mount.lustre.0 Request processed in 124us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941144.350061:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788941144.350097:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102285952:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788941144.350680:0:23428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788941144.352313:0:23428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.352330:0:23428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941144.352803:0:23428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cac84eb800 from 1 10000000:01000000:0.0:1788941144.352809:0:23428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788941144.352886:0:23428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.352895:0:23428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.352904:0:23428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941144.352929:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941144.353013:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.353047:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf903e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788941144.353360:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102286080 00000100:00100000:3.0:1788941144.353434:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102286080 00000100:00100000:3.0:1788941144.353556:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788941144.353568:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:23428:x1875840102286080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941144.353583:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941144.353609:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ed4e expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.353635:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 17 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.353646:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 17 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.353916:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f40000, rc 0) 00000100:00100000:3.0:1788941144.353980:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286080:12345-0@lo:101:mount.lustre.0 Request processed in 414us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941144.353987:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788941144.354121:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941144.354138:0:23428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.354147:0:23428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788941144.359283:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788941144.360357:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788941144.360942:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788941144.360969:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788941144.360983:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788941144.360994:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788941144.361007:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788941144.361020:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788941144.361034:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788941144.361048:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788941144.361062:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788941144.361074:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788941144.361082:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788941144.361093:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788941144.361096:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788941144.361188:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941144.361256:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.361299:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf903ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788941144.361797:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102286208 00000100:00100000:2.0:1788941144.361806:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102286208 00000100:00100000:2.0:1788941144.361935:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788941144.361954:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941144.362299:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286208:12345-0@lo:501:mount.lustre.0 Request processed in 346us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.362307:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788941144.362642:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941144.362689:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941144.362804:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.362913:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941144.363039:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102286336 00000100:00100000:3.0:1788941144.363046:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102286336 00000100:00100000:3.0:1788941144.363129:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788941144.363140:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941144.363272:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286336:12345-0@lo:503:mount.lustre.0 Request processed in 135us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941144.363280:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788941144.363356:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286336:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788941144.363806:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788941144.363932:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941144.363982:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.364571:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788941144.364674:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102286464 00000100:00100000:2.0:1788941144.364681:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102286464 00000100:00100000:2.0:1788941144.364727:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788941144.364735:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941144.365011:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286464:12345-0@lo:502:mount.lustre.0 Request processed in 276us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.365019:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788941144.366076:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788941144.366507:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788941144.366540:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788941144.366555:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788941144.366600:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788941144.366618:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1788941144.366643:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1788941144.366656:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1788941144.366669:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1788941144.366683:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788941144.367866:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1788941144.367917:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1788941144.368042:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941144.368126:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.368234:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788941144.368562:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102286592 00000100:00100000:3.0:1788941144.368571:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102286592 00000100:00100000:3.0:1788941144.368660:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788941144.368670:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941144.368826:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286592:12345-0@lo:502:mount.lustre.0 Request processed in 156us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941144.368872:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788941144.369189:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788941144.369264:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788941144.369276:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788941144.370573:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941144.370582:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941144.370592:0:23442:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788941144.370600:0:23442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cac84eb800 00000020:00000080:1.0:1788941144.370602:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788941144.370608:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941144.370611:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941144.370612:0:23442:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788941144.370615:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941144.370617:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941144.370619:0:23442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788941144.370622:0:23442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cac84eb800 00000020:00000080:1.0:1788941144.370624:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788941144.370686:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941144.370690:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941144.370692:0:23442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788941144.370753:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941144.370757:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941144.370758:0:23442:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788941144.370761:0:23442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cac84eb800 00000020:00000080:1.0:1788941144.370769:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788941144.370784:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941144.370786:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941144.370786:0:23442:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788941144.370788:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941144.370790:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941144.370790:0:23442:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788941144.370792:0:23442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cac84eb800 00000020:00000080:1.0:1788941144.370793:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788941144.370806:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941144.370808:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941144.370809:0:23442:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788941144.370812:0:23442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788941144.374065:0:23428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788941144.374120:0:23428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788941144.374141:0:23428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.374155:0:23428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941144.374513:0:23428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788941144.374517:0:23428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cac84eb800 10000000:01000000:1.0:1788941144.374519:0:23428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cac84eb800 10000000:01000000:1.0:1788941144.374524:0:23428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788941144.374531:0:23428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cac84eb800 from 1 10000000:01000000:1.0:1788941144.374534:0:23428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788941144.374579:0:23428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a5c00/0x24b6539075b3ed5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.374600:0:23428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac19a5c00/0x24b6539075b3ed5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.374625:0:23428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac19a5c00/0x24b6539075b3ed5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941144.374652:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788941144.375331:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.375383:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941144.375467:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102286720 00000100:00100000:3.0:1788941144.375475:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102286720 00000100:00100000:3.0:1788941144.375528:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788941144.375539:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:23428:x1875840102286720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941144.375553:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941144.375567:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7f40c00/0x24b6539075b3ed63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ed5c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.375615:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f40c00/0x24b6539075b3ed63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ed5c expref: 18 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.375626:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7f40c00/0x24b6539075b3ed63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed5c expref: 18 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.375634:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f40c00, rc 0) 00000100:00100000:3.0:1788941144.375678:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102286720:12345-0@lo:101:mount.lustre.0 Request processed in 140us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941144.375684:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788941144.376333:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941144.376350:0:23428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac19a5c00/0x24b6539075b3ed5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed63 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.376360:0:23428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac19a5c00/0x24b6539075b3ed5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ed63 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788941144.385100:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1788941144.385526:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788941144.393194:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1788941144.393350:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1788941144.393359:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1788941144.393372:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1788941144.393384:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1788941144.393396:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1788941144.393408:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1788941144.393421:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1788941144.393435:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1788941144.393443:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1788941144.393450:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1788941144.393458:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1788941144.393464:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1788941144.393471:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1788941144.393549:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1788941144.393559:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1788941144.393566:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1788941144.393573:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1788941144.393580:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1788941144.393609:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1788941144.393630:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1788941144.393643:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1788941144.393666:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1788941144.393680:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1788941144.393757:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1788941144.393780:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1788941144.393794:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1788941144.393808:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1788941144.393821:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1788941144.393851:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1788941144.393880:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1788941144.393895:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1788941144.393909:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1788941144.393922:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1788941144.393936:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1788941144.394104:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1788941144.394124:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1788941144.394139:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1788941144.394152:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1788941144.394166:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1788941144.394181:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1788941144.394195:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1788941144.394293:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1788941144.394307:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1788941144.394320:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1788941144.394332:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1788941144.394364:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1788941144.394380:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1788941144.394630:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1788941144.394653:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1788941144.394673:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1788941144.394679:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1788941144.395144:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941144.395570:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.395730:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941144.400611:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102286848 00000100:00100000:0.0:1788941144.400631:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102286848 00000100:00100000:0.0:1788941144.400693:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788941144.401044:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102286848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941144.401403:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102286848:12345-0@lo:501:mount.lustre.0 Request processed in 364us (5833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941144.401411:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788941144.401600:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941144.401658:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941144.402089:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.402149:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102286976 00000100:00100000:1.0:1788941144.402155:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102286976 00000100:00100000:1.0:1788941144.402194:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788941144.402614:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102286976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941144.402784:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102286976:12345-0@lo:503:mount.lustre.0 Request processed in 582us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.402791:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788941144.402857:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.402878:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102286976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788941144.404463:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788941144.404920:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102287104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941144.405433:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.405809:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfc0ddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788941144.407278:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102287104 00000100:00100000:0.0:1788941144.407289:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102287104 00000100:00100000:1.0:1788941144.407457:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788941144.407471:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102287104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941144.407664:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102287104:12345-0@lo:502:mount.lustre.0 Request processed in 195us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.407672:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788941144.407828:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102287104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941144.408236:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788941144.408267:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788941144.408282:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788941144.408295:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788941144.408309:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788941144.408322:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788941144.408334:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788941144.408346:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788941144.408360:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788941144.408372:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788941144.408385:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788941144.408399:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788941144.408425:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788941144.408439:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788941144.408451:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788941144.408464:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788941144.408498:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788941144.408514:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788941144.408526:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788941144.408538:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788941144.408550:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788941144.408561:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788941144.408573:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788941144.408597:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788941144.408613:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788941144.408626:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788941144.408638:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788941144.408649:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788941144.408674:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788941144.408688:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788941144.408713:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788941144.408727:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788941144.408739:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788941144.408751:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788941144.408763:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788941144.408774:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788941144.408784:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788941144.408796:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788941144.408807:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788941144.408819:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788941144.408831:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788941144.408875:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788941144.408887:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788941144.408899:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788941144.408926:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788941144.408942:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788941144.409208:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788941144.409223:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788941144.409268:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102287232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941144.409338:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.409651:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102287232 00000100:00100000:0.0:1788941144.409659:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102287232 00000100:00100000:0.0:1788941144.409710:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788941144.409720:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102287232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941144.409823:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102287232:12345-0@lo:502:mount.lustre.0 Request processed in 105us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941144.409830:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788941144.410258:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfda7eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941144.410280:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102287232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941144.410455:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788941144.410480:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788941144.410642:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102287360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941144.410683:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.410726:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102287360 00000100:00100000:0.0:1788941144.410732:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102287360 00000100:00100000:0.0:1788941144.410759:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788941144.410767:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102287360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941144.410854:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102287360:12345-0@lo:502:mount.lustre.0 Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941144.410861:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788941144.410893:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc90a80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941144.410905:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102287360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941144.410942:0:23428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788941144.411078:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788941144.412279:0:23448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788941144.412297:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff99cbf9390000) 00000020:00000080:2.0:1788941144.412322:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788941144.412407:0:23448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cac84eb800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788941144.412411:0:23448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cac84eb800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788941144.412413:0:23448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cac84eb800 3 00010000:00080000:2.0:1788941144.412446:0:23448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbfc14d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788941144.418225:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788941144.418426:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788941144.418490:0:23448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788941144.418504:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x24b6539075b3ed71 00000100:00080000:3.0:1788941144.418514:0:23448:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941144.418527:0:23448:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbfc14d000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941144.418566:0:23448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b86300 x1875840102287488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941144.418677:0:23448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788941144.418737:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875840102287488:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941144.418809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788941144.418995:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00080000:2.0:1788941144.419080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941144.419085:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941144.419088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941144.419091:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788941144.419142:0:23428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788941144.419175:0:23428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788941144.419192:0:23428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a5c00/0x24b6539075b3ed5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed63 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941144.419214:0:23428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac19a5c00/0x24b6539075b3ed5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed63 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788941144.419259:0:23428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788941144.419261:0:23428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788941144.419263:0:23428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941144.419264:0:23428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941144.419265:0:23428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941144.419266:0:23428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941144.419268:0:23428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788941144.419270:0:23428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941144.419271:0:23428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788941144.419274:0:23428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788941144.419276:0:23428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788941144.419278:0:23428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788941144.419279:0:23428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941144.419280:0:23428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941144.419281:0:23428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941144.419282:0:23428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941144.419282:0:23428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788941144.419284:0:23428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941144.419284:0:23428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788941144.419299:0:23428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788941144.419311:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102287616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788941144.419346:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.419371:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102287616 00000100:00100000:0.0:1788941144.419378:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102287616 00000100:00100000:0.0:1788941144.419416:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788941144.419425:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102287616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788941144.419451:0:22688:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788941144.419468:0:22688:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788941144.419562:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc90a89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.420966:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102287488 00000100:00100000:1.0:1788941144.420979:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102287488 00000100:00100000:1.0:1788941144.421018:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941144.421025:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875840102287488:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788941144.421060:0:22697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:1.0:1788941144.421101:0:22697:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x24b6539075b3ed78 00000004:00100000:1.0:1788941144.421116:0:22697:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788941144.421150:0:22697:0:(import.c:65:import_set_state_nolock()) ffff99cbcb901800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941144.421291:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875840102287488:12345-0@lo:38:llog_process_th.0 Request processed in 265us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.421299:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788941144.421444:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cc01b86300 x1875840102287488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941144.421457:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941144.421466:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788941144.421472:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000001:00100000:0.0:1788941144.421579:0:22676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788941144.421625:0:22688:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788941144.421641:0:22688:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788941144.421689:0:22712:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788941144.421694:0:22712:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788941144.421713:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.421728:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 18 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.421736:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 18 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.421743:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.421776:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 18 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.421790:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 18 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941144.421802:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102287744:0@lo:104: 00000100:00100000:1.0:1788941144.421864:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788941144.421912:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 18 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.421921:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 18 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941144.421929:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102287872:0@lo:104: 00000100:00100000:0.0:1788941144.421937:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:23428:x1875840102287616:12345-0@lo:253:mount.lustre.0 Request processed in 2513us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.421948:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.421964:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcb0bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.421979:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102287744 00000100:00100000:1.0:1788941144.421983:0:22679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102287744 00000100:00100000:1.0:1788941144.422004:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102287872 00000100:00100000:1.0:1788941144.422006:0:22679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102287872 00000100:00100000:1.0:1788941144.422018:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941144.422025:0:22679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:22712:x1875840102287744:12345-0@lo:104: 00010000:00010000:1.0:1788941144.422036:0:22679:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788941144.422037:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788941144.422041:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfc14d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788941144.422048:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875840102287488:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1788941144.422076:0:22679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788941144.422081:0:22679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:22712:x1875840102287744:12345-0@lo:104: Request processed in 58us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.422088:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941144.422100:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941144.422106:0:22679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:22712:x1875840102287872:12345-0@lo:104: 00010000:00010000:1.0:1788941144.422113:0:22679:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422150:0:22679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788941144.422156:0:22679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:22712:x1875840102287872:12345-0@lo:104: Request processed in 51us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.422168:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788941144.422185:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941144.422192:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422266:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41800 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941144.422271:0:22685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422280:0:22685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941144.422287:0:22685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941144.422292:0:22685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788941144.422315:0:22685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422321:0:22685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941144.422339:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422344:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7f41800/0x24b6539075b3ed40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed47 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422355:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941144.422357:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422371:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5400 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941144.422374:0:22685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422380:0:22685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941144.422385:0:22685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941144.422390:0:22685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788941144.422401:0:22685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422405:0:22685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941144.422421:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422426:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac19a5400/0x24b6539075b3ec7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec83 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422439:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941144.422440:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941144.422442:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941144.422453:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102288128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941144.422481:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.422509:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102288128 00000100:00100000:1.0:1788941144.422513:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102288128 00010000:00010000:1.0:1788941144.422529:0:22681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 19 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941144.422559:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941144.422565:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:3651:x1875840102288128:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941144.422567:0:22682:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788941144.422575:0:22682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788941144.422575:0:22681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941144.422580:0:22681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 19 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422600:0:22681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 19 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.422684:0:22681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941144.422713:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:3651:x1875840102288128:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.422719:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941144.422744:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102288128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941144.422764:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102287744:0@lo:104: 00010000:00010000:1.0:1788941144.422773:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfc09b600/0x24b6539075b3ec83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ec7c expref: 18 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941144.422784:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102287872:0@lo:104: 00010000:00010000:1.0:1788941144.422798:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941144.422811:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941144.422820:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3650:1875840102288000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941144.422871:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.423026:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788941144.423070:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:23428:1875840102287616:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788941144.423080:0:23428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788941144.423083:0:23428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788941144.423085:0:23428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788941144.423087:0:23428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941144.423089:0:23428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941144.423090:0:23428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941144.423091:0:23428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941144.423093:0:23428:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788941144.423095:0:23428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941144.423096:0:23428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788941144.423107:0:23428:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788941144.424331:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102288000 00000100:00100000:3.0:1788941144.424340:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102288000 00010000:00010000:3.0:1788941144.424366:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 17 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941144.424391:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788941144.424397:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:3650:x1875840102288000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941144.424404:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941144.424407:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 17 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424415:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 17 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424424:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec5400/0x24b6539075b3ed47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ed40 expref: 17 pid: 22688 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424433:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424440:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788941144.424451:0:22683:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003076105s 00010000:00010000:3.0:1788941144.424454:0:22683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424458:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424468:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424473:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424476:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5600 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941144.424490:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424496:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424508:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941144.424519:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788941144.424533:0:22712:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.424541:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941144.424554:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac19a5600/0x24b6539075b3ed7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941144.424574:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:3650:x1875840102288000:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941144.424581:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788941144.427745:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3650:1875840102288000:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1788941144.429198:0:23428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788941144.429337:0:23455:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788941144.429341:0:23455:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788941144.429414:0:23456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788941144.429685:0:23428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788941144.430648:0:23457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1875840102288256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788941144.430724:0:23457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.430755:0:23457:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf69219c0 going to sleep for 11 seconds 00000040:01000000:2.0:1788941144.430758:0:23428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788941144.430795:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941144.430896:0:23456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788941144.431541:0:23428:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788941144.431550:0:23428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788941144.431605:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941144.433374:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788941144.434129:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:2.0:1788941144.434292:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102288256 00000100:00100000:2.0:1788941144.434302:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102288256 00000100:00100000:2.0:1788941144.434358:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788941144.434367:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23457:x1875840102288256:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788941144.434458:0:23456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:2.0:1788941144.434490:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23457:x1875840102288256:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (3766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941144.434498:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:2.0:1788941144.434523:0:23428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788941144.434755:0:23428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788941144.434914:0:23457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1875840102288256:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788941144.434968:0:23457:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788941144.435040:0:23457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1875840102288384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788941144.435086:0:23457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.435113:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102288384 00000100:00100000:0.0:1788941144.435117:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102288384 00000100:00100000:0.0:1788941144.435151:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788941144.435163:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23457:x1875840102288384:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788941144.435250:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23457:x1875840102288384:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000004:00080000:3.0:1788941144.435314:0:23456:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00080000:10000000:2.0:1788941144.435560:0:23428:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:0.0:1788941144.435645:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788941144.435668:0:23457:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941144.435685:0:23457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1875840102288384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788941144.435815:0:23457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23457:1875840102288512:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788941144.436223:0:23457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941144.436288:0:23457:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788941144.436335:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102288512 00000100:00100000:3.0:1788941144.436340:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102288512 00000100:00100000:3.0:1788941144.436408:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788941144.436416:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1875840102288512:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788941144.436566:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1875840102288512:12345-0@lo:900:lod0001_rec0000.0 Request processed in 151us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941144.436573:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788941144.436630:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cbfeb96300 x1875840102288512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788941160 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941144.436642:0:23457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23457:1875840102288512:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788941144.436684:0:23457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1875840102288640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788941144.436807:0:23457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941144.437005:0:23457:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941144.437093:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102288640 00000100:00100000:1.0:1788941144.437098:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102288640 00000100:00100000:1.0:1788941144.437132:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941144.437143:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23457:x1875840102288640:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788941144.437209:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23457:x1875840102288640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 72us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941144.437216:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788941144.437272:0:23457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1875840102288640:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788941144.437317:0:23457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:2.0:1788941144.437416:0:23428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:0.0:1788941144.439765:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788941144.439870:0:23457:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788941144.439875:0:23457:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788941144.446120:0:23428:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788941144.446161:0:23428:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb1f200d7f988 00100000:10000000:2.0:1788941144.446170:0:23428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788941144.449243:0:23428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788941144.449279:0:23428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788941144.449300:0:23428:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788941144.449316:0:23428:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788941144.451458:0:23428:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941144.453476:0:23428:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788941144.899978:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941145.220804:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00000040:00080000:2.0:1788941145.485424:0:23449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788941145.860784:0:22693:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788941145.860796:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cac84eb800 from 12 10000000:01000000:3.0:1788941145.860805:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788941145.862634:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941145.862652:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941145.862664:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941145.862694:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102288768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788941145.862778:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941145.862829:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfc0a3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788941145.864254:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102288768 00000100:00100000:2.0:1788941145.864269:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102288768 00000100:00100000:2.0:1788941145.864360:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788941145.864369:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:22693:x1875840102288768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941145.864389:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941145.864408:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ed86 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941145.864439:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941145.864451:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941145.864471:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4400, rc 0) 00000100:00100000:2.0:1788941145.864551:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102288768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941145.864725:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102288768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941145.864748:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941145.864760:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941145.864865:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102288896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788941145.864913:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941145.864945:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc6c74e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788941145.865008:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788941145.865038:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102288896 00000100:00100000:2.0:1788941145.865042:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102288896 00000100:00100000:2.0:1788941145.865056:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788941145.865063:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102288896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788941145.865079:0:22691:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788941145.865110:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788941145.865113:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788941145.865312:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102288896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 249us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941145.865320:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788941145.865443:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102288896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788941145.865504:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788941145.865512:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941145.865522:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941145.865533:0:22693:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788941145.865536:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cbe5775000 from 12 10000000:01000000:0.0:1788941145.865538:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788941145.865574:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941145.865582:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941145.865591:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941145.865604:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102289024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788941145.865628:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941145.865650:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc6c74e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788941145.865805:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102289024 00000100:00100000:2.0:1788941145.865810:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102289024 00000100:00100000:2.0:1788941145.865864:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788941145.865877:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102289024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941145.865886:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941145.865895:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ed94 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941145.865912:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 18 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941145.865921:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 18 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941145.865928:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4200, rc 0) 00000100:00100000:2.0:1788941145.865954:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:22693:x1875840102289024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941145.865960:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788941145.866473:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102289024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941145.866489:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941145.866510:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941145.866680:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102289152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788941145.866717:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941145.866751:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc6c74e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788941145.866808:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102289152 00000100:00100000:2.0:1788941145.866813:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102289152 00000100:00100000:2.0:1788941145.866884:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788941145.866892:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:22693:x1875840102289152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788941145.866907:0:22691:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788941145.866924:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788941145.866927:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788941145.867000:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:22693:x1875840102289152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941145.867006:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788941145.867126:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102289152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788941145.867280:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788941145.867287:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941145.867296:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941145.925598:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941146.244996:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00000040:00080000:0.0:1788941146.501083:0:23449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941146.947943:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941147.268388:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:3.0:1788941147.972830:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941148.292959:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788941148.996966:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941149.318284:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 0 seconds 00000100:00080000:1.0:1788941149.579556:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788941149.579564:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788941149.579569:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941149.579586:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cc01ab8800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941149.579608:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8596a00 x1875840102289408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941149.579638:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941149.579642:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941149.579644:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941149.579647:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941149.579673:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941149.579676:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941149.579679:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941149.579682:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941149.579723:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875840102289792:0@lo:400:kworker.0 00000100:00100000:1.0:1788941149.579788:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941149.579824:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788941149.579831:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102289280:0@lo:400:kworker.0 00000100:00100000:1.0:1788941149.580028:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941149.580054:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102289920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941149.580079:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941149.580125:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102289280 00000100:00100000:1.0:1788941149.580135:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102289280 00000100:00100000:1.0:1788941149.580181:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788941149.580190:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:3651:x1875840102289280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941149.580244:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:3651:x1875840102289280:12345-0@lo:400:kworker.0 Request processed in 55us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941149.580250:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788941149.580291:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102289920 00000100:00100000:1.0:1788941149.580295:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102289920 00000100:00100000:1.0:1788941149.580317:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941149.580323:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102289920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941149.580353:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941149.580387:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102289920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941149.580393:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941149.580427:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102289280:0@lo:400:kworker.0 00000100:00100000:1.0:1788941149.580446:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102289920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941149.580585:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102289536:0@lo:400:kworker.0 00000100:00100000:2.0:1788941149.580625:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941149.580656:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788941149.580661:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102289664:0@lo:400:kworker.0 00000100:00100000:2.0:1788941149.580679:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941149.580706:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102289792 00000100:00100000:2.0:1788941149.580709:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102289792 00000100:00100000:2.0:1788941149.580874:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102289536 00000100:00100000:2.0:1788941149.580878:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102289536 00000100:00100000:2.0:1788941149.580897:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788941149.580903:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875840102289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941149.580943:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875840102289792:12345-0@lo:400:kworker.0 Request processed in 40us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941149.580950:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788941149.580962:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788941149.580968:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102289536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941149.580998:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102289536:12345-0@lo:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941149.581004:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788941149.581025:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102289664 00000100:00100000:2.0:1788941149.581028:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102289664 00000100:00100000:2.0:1788941149.581046:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788941149.581052:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102289664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941149.581081:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102289664:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941149.581086:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788941149.581388:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cac8594a80 x1875840102289792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941149.581401:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875840102289792:0@lo:400:kworker.0 00000100:00100000:3.0:1788941149.581424:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102289408:0@lo:38:kworker.0 00000100:00100000:3.0:1788941149.581455:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941149.581504:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102289408 00000100:00100000:3.0:1788941149.581508:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102289408 00000100:00100000:3.0:1788941149.581523:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788941149.581527:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875840102289408:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788941149.581557:0:22701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 758 last 0 00000020:00000080:3.0:1788941149.581594:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b6539075b3eda2 00000004:00100000:3.0:1788941149.581610:0:22701:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788941149.581615:0:22701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788941149.581699:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102289664:0@lo:400:kworker.0 00010000:00080000:3.0:1788941149.581709:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cac8596d80 x1875840102289536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941149.581716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102289536:0@lo:400:kworker.0 00000100:00080000:3.0:1788941149.598199:0:22701:0:(import.c:65:import_set_state_nolock()) ffff99cbc460f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788941149.598335:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875840102289408:12345-0@lo:38:kworker.0 Request processed in 16803us (16876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941149.598347:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788941149.598547:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788941149.598559:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788941149.598581:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788941149.598586:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cc01ab8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788941149.598659:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e1bd0da0): req@ffff99cac8594000 x1875840102281984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941149.598682:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102289408:0@lo:38:kworker.0 00000100:00100000:2.0:1788941149.598763:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941149.598791:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbe57bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788941149.598807:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102281984 00000100:00100000:2.0:1788941149.598814:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102281984 00000100:00100000:2.0:1788941149.598879:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941149.598889:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22738:x1875840102281984:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941149.598977:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22738:x1875840102281984:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941149.598984:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941149.599022:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22738:1875840102281984:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788941149.599055:0:22738:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788941149.599093:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22738:1875840102290048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941149.599132:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941149.599144:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbca8a6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788941149.599154:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102290048 00000100:00100000:2.0:1788941149.599157:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102290048 00000100:00100000:2.0:1788941149.599174:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788941149.599179:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22738:x1875840102290048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941149.599259:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22738:x1875840102290048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941149.599264:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788941149.599299:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22738:1875840102290048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941149.599373:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22738:1875840102290176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941149.599396:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941149.599410:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf6921f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788941149.599421:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102290176 00000100:00100000:2.0:1788941149.599424:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102290176 00000100:00100000:2.0:1788941149.599444:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788941149.599449:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22738:x1875840102290176:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941149.599508:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22738:x1875840102290176:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 58us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941149.599514:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788941149.599540:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22738:1875840102290176:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788941149.599580:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941149.620411:0:22738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788941149.620518:0:22738:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:2.0:1788941149.620523:0:22738:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1788941149.622467:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102290304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941149.622553:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941149.622749:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102290304 00000100:00100000:1.0:1788941149.622759:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102290304 00000100:00100000:1.0:1788941149.622817:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788941149.622829:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875840102290304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941149.622900:0:22702:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941149.622984:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875840102290304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941149.622990:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788941149.630889:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102290304:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788941150.024062:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788941150.048185:0:23700:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1788941150.284111:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941151.045158:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788941151.441761:0:23752:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941151.442008:0:23752:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788941152.068184:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788941152.551291:0:23802:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941152.552640:0:23802:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788941153.094544:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941153.676511:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941138/real 1788941138] req@ffff99cac8596680 x1875840102283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941153 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941153.676560:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cac8596680 x1875840102283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941153 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941153.676572:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941138/real 1788941138] req@ffff99cac8597800 x1875840102283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941153 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941153.676585:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cac8597800 x1875840102283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941153 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788941153.676609:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfc148800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788941153.676623:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788941153.676627:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102283008:0@lo:8:kworker.0 00000100:00080000:3.0:1788941153.676648:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788941153.676653:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788941153.676656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102283136:0@lo:8:kworker.0 00000100:00080000:1.0:1788941153.676972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941153.676976:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788941153.676979:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cbfc148800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941153.676983:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 746 00000100:00080000:1.0:1788941153.676989:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788941153.677006:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cbfc148800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941153.677028:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9a33b80 x1875840102290688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941153.677043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941153.677046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788941153.677048:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941153.677051:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 746 00000100:00080000:1.0:1788941153.677053:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788941153.677057:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbfea41000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941153.677067:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9a31f80 x1875840102290816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941153.677087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941153.677091:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941153.677094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941153.677097:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941153.677124:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102291072:0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677187:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941153.677257:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788941153.677263:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677291:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941153.677312:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102291200:0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677334:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941153.677362:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102290560:0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677406:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941153.677438:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941153.677444:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102290944:0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677466:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941153.677496:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102291072 00000100:00100000:1.0:1788941153.677503:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102291072 00000100:00100000:1.0:1788941153.677590:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102290560 00000100:00100000:1.0:1788941153.677594:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102290560 00000100:00100000:1.0:1788941153.677612:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788941153.677621:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102291072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677676:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102291072:12345-0@lo:400:kworker.0 Request processed in 56us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941153.677683:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788941153.677699:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788941153.677705:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875840102290560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677734:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875840102290560:12345-0@lo:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941153.677740:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788941153.677756:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102290432 00000100:00100000:1.0:1788941153.677759:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102290432 00000100:00100000:1.0:1788941153.677783:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788941153.677790:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:3649:x1875840102290432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677818:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:3649:x1875840102290432:12345-0@lo:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941153.677824:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788941153.677880:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102291200 00000100:00100000:1.0:1788941153.677884:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102291200 00000100:00100000:1.0:1788941153.677920:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102290944 00000100:00100000:1.0:1788941153.677923:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102290944 00000100:00100000:1.0:1788941153.677937:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788941153.677943:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102291200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.677971:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102291200:12345-0@lo:400:kworker.0 Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941153.677977:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788941153.677989:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788941153.677996:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102290944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.678022:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102290944:12345-0@lo:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941153.678028:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788941153.678072:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cbc9a31880 x1875840102290944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941153.678085:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102290944:0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.678094:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102290560:0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.678115:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102290688:0@lo:8:kworker.0 00000400:00000100:1.0:1788941153.678152:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102290688 offset 0 length 520: 4 00000100:00100000:1.0:1788941153.678165:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102290816:0@lo:8:kworker.0 00000400:00000100:1.0:1788941153.678181:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102290816 offset 0 length 520: 4 00000100:00100000:1.0:1788941153.678208:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102290432:0@lo:400:kworker.0 00010000:00080000:1.0:1788941153.678218:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cbc9a33800 x1875840102291200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941153.678226:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102291200:0@lo:400:kworker.0 00000100:00100000:1.0:1788941153.678243:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102291072:0@lo:400:kworker.0 00000020:00000080:2.0:1788941153.981599:0:23850:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd112ad6e0 20000000:00000080:2.0:1788941153.981620:0:23850:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cbfdfe7800 uarg=0000000000000000 20000000:01000000:2.0:1788941153.981664:0:23850:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788941153.981684:0:23850:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788941153.981689:0:23850:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788941153.987509:0:23851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788941153.991118:0:23850:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788941153.999367:0:23850:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788941153.999493:0:23850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941153.999514:0:23850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941153.999523:0:23850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 17 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941153.999530:0:23850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941153.999575:0:23850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 17 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941153.999591:0:23850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 17 pid: 22689 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941153.999606:0:23850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23850:1875840102291328:0@lo:104: 00000100:00100000:2.0:1788941154.000127:0:23850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941154.000301:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102291328 00000100:00100000:1.0:1788941154.000309:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102291328 00000100:00100000:1.0:1788941154.000373:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941154.000382:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:23850:x1875840102291328:12345-0@lo:104: 00010000:00010000:1.0:1788941154.000398:0:22680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.000466:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788941154.000473:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:23850:x1875840102291328:12345-0@lo:104: Request processed in 92us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941154.000480:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788941154.000502:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941154.000507:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.000515:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09ae00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941154.000519:0:22684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.000527:0:22684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941154.000535:0:22684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941154.000541:0:22684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788941154.000580:0:22684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.000588:0:22684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941154.000607:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.000615:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfc09ae00/0x24b6539075b3ed4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed55 expref: -99 pid: 23428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.000629:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941154.000631:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941154.000632:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941154.000644:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102291456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941154.000689:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941154.000738:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102291456 00000100:00100000:1.0:1788941154.000742:0:23451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102291456 00010000:00010000:1.0:1788941154.000761:0:23451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 18 pid: 22689 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941154.000785:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941154.000791:0:23451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:3651:x1875840102291456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941154.000802:0:23451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941154.000806:0:23451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 18 pid: 22689 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.000815:0:23451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 18 pid: 22689 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.000830:0:23451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941154.000886:0:23451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:3651:x1875840102291456:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941154.000893:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941154.001064:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102291456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941154.004964:0:23850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941154.004986:0:23850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 17 pid: 22691 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941154.005000:0:23850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23850:1875840102291584:0@lo:104: 00000100:00100000:3.0:1788941154.005063:0:23850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941154.005100:0:23850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf90489c0 going to sleep for 10 seconds 00010000:00010000:3.0:1788941154.005125:0:23850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f40000/0x24b6539075b3ed55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ed4e expref: 17 pid: 22689 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941154.005140:0:23850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23850:1875840102291328:0@lo:104: 00000100:00100000:1.0:1788941154.005365:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102291584 00000100:00100000:1.0:1788941154.005373:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102291584 00000100:00100000:1.0:1788941154.005453:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788941154.005463:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:23850:x1875840102291584:12345-0@lo:104: 00010000:00010000:1.0:1788941154.005477:0:22680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.005529:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788941154.005534:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:23850:x1875840102291584:12345-0@lo:104: Request processed in 74us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941154.005540:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788941154.005558:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941154.005564:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.005570:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4a00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:1.0:1788941154.005574:0:22685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.005582:0:22685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941154.005589:0:22685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941154.005612:0:22685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788941154.005640:0:22685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.005646:0:22685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941154.005667:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.005674:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac19a4a00/0x24b6539075b3ec4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ec52 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941154.005688:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941154.005689:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941154.005691:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941154.005702:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102291712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941154.005728:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941154.006074:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102291712 00000100:00100000:0.0:1788941154.006080:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102291712 00010000:00010000:0.0:1788941154.006103:0:22682:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 17 pid: 22691 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941154.006130:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788941154.006136:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:3652:x1875840102291712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941154.006147:0:22682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941154.006152:0:22682:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 17 pid: 22691 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006169:0:22682:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 17 pid: 22691 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006185:0:22682:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006193:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006218:0:22682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006224:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006228:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006232:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006235:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5c00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941154.006238:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006243:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006248:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006262:0:22682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941154.006294:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:3652:x1875840102291712:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941154.006299:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788941154.006336:0:23850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3ec52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ec4b expref: 16 pid: 22691 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941154.006343:0:23850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23850:1875840102291584:0@lo:104: 00010000:00010000:0.0:1788941154.006360:0:23850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006366:0:23850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006370:0:23850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941154.006376:0:23850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3eda9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941154.007189:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102291712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941154.119580:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941154.692688:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941144/real 1788941144] req@ffff99cbfea7df80 x1875840102285696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941154 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941154.692745:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cbfea7df80 x1875840102285696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941154 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941154.692756:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941144/real 1788941144] req@ffff99cc01b87100 x1875840102285056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941154 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941154.692767:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cc01b87100 x1875840102285056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941154 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788941154.692794:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788941154.692944:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102291840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941154.693052:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941154.693123:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102291840 00000100:00100000:1.0:1788941154.693136:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102291840 00000100:00100000:1.0:1788941154.693204:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788941154.693215:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102291840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941154.693268:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941154.693325:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102291840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941154.693333:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788941154.693394:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102291840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941154.695306:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941154.695326:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102291968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788941154.695427:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941154.695499:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102291968 00000100:00100000:1.0:1788941154.695509:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102291968 00000100:00100000:1.0:1788941154.695557:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788941154.695565:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875840102291968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941154.695612:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941154.695668:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875840102291968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941154.695676:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788941154.697395:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102291968:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788941154.704285:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788941154.704302:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102285696:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788941154.704329:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac5a58800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788941154.704349:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788941154.704354:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102285056:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788941154.704825:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941154.704832:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941154.704859:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941154.704863:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941154.704883:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941154.704886:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788941154.704890:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cac5a58800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941154.704896:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 752 00000100:00080000:1.0:1788941154.704903:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788941154.704919:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cac5a58800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941154.704948:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9a32680 x1875840102292352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941154.704983:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941154.704986:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788941154.705093:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941154.705100:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 753 00000100:00080000:1.0:1788941154.705104:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788941154.705110:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99cbfda41800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941154.705125:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9a30700 x1875840102292480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941154.705168:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788941154.705189:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102292608:0@lo:400:kworker.0 00000100:00100000:1.0:1788941154.705280:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941154.705338:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875840102292224:0@lo:400:kworker.0 00000100:00100000:1.0:1788941154.705365:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941154.705386:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788941154.705391:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102292096:0@lo:400:kworker.0 00000100:00100000:1.0:1788941154.705438:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941154.705505:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102292608 00000100:00100000:1.0:1788941154.705517:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102292608 00000100:00100000:1.0:1788941154.705587:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102292224 00000100:00100000:1.0:1788941154.705590:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102292224 00000100:00100000:1.0:1788941154.705612:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788941154.705622:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102292608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941154.705705:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102292608:12345-0@lo:400:kworker.0 Request processed in 83us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941154.705890:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788941154.705897:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102292352:0@lo:8:kworker.0 00000100:00100000:1.0:1788941154.705932:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788941154.705942:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875840102292224:12345-0@lo:400:kworker.0 00000400:00000100:2.0:1788941154.708198:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102292352 offset 0 length 520: 4 00000100:00100000:1.0:1788941154.712365:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875840102292224:12345-0@lo:400:kworker.0 Request processed in 6408us (6981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941154.712388:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788941154.712499:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102292096 00000100:00100000:1.0:1788941154.712513:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102292096 00000100:00100000:1.0:1788941154.713273:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788941154.713293:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:3652:x1875840102292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941154.713397:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:3652:x1875840102292096:12345-0@lo:400:kworker.0 Request processed in 112us (7959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941154.713415:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788941154.713515:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cbc9a33100 x1875840102292608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941154.713535:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102292608:0@lo:400:kworker.0 00000100:00100000:2.0:1788941154.722132:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102292480:0@lo:8:kworker.0 00000400:00000100:2.0:1788941154.722202:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840102292480 offset 0 length 520: 4 00000100:00100000:3.0:1788941154.726593:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102292096:0@lo:400:kworker.0 00010000:00080000:3.0:1788941154.726619:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cbc9a30000 x1875840102292224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941154.726632:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875840102292224:0@lo:400:kworker.0 00010000:00010000:2.0:1788941155.144424:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788941155.212440:0:23429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:0.0:1788941155.651899:0:22693:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788941155.651907:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cac84eb800 from 13 10000000:01000000:0.0:1788941155.651914:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788941155.651967:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941155.651981:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941155.652006:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941155.652034:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102292736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788941155.652112:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941155.652161:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc333e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941155.652649:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102292736 00000100:00100000:1.0:1788941155.652658:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102292736 00000100:00100000:1.0:1788941155.652718:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788941155.652727:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+16:22693:x1875840102292736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788941155.652741:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941155.652756:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3edb0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941155.652780:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 17 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941155.652791:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 17 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941155.652808:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac19a4e00, rc 0) 00000100:00100000:1.0:1788941155.652899:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102292736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941155.652906:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788941155.653265:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102292736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941155.653292:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941155.653301:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941155.653376:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102292864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941155.653414:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941155.653442:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc333e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941155.654444:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102292864 00000100:00100000:1.0:1788941155.654454:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102292864 00000100:00100000:1.0:1788941155.654507:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788941155.654518:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102292864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941155.654689:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102292864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941155.654696:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788941155.656267:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102292864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941155.656335:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102292992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941155.656555:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941155.656593:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc333e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941155.659552:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102292992 00000100:00100000:1.0:1788941155.659568:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102292992 00000100:00100000:1.0:1788941155.659623:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788941155.659632:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102292992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941155.659983:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102292992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 349us (3565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941155.659992:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788941155.660447:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102292992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788941155.664913:0:23912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788941155.668360:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788941155.668412:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788941155.668431:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941155.668446:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941155.668458:0:22693:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788941155.668461:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cbe5775000 from 13 10000000:01000000:0.0:1788941155.668464:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788941155.668500:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941155.668508:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941155.668520:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941155.668550:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102293120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788941155.668646:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941155.668795:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfd94de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941155.674522:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102293120 00000100:00100000:1.0:1788941155.674538:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102293120 00000100:00100000:2.0:1788941155.675009:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788941155.675021:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+17:22693:x1875840102293120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941155.675040:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941155.675058:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3edbe expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941155.675085:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3edbe expref: 18 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941155.675096:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3edbe expref: 18 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941155.675105:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4000, rc 0) 00000100:00100000:2.0:1788941155.675185:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:22693:x1875840102293120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (6539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941155.675192:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788941155.675292:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102293120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788941155.675312:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941155.675323:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941155.675421:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102293248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941155.675457:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941155.675497:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfecd3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788941155.675558:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102293248 00000100:00100000:0.0:1788941155.675563:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102293248 00000100:00100000:0.0:1788941155.675596:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788941155.675603:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:22693:x1875840102293248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941155.675707:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:22693:x1875840102293248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941155.675714:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788941155.675811:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102293248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941155.675880:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102293376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941155.675921:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941155.675937:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfecd3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788941155.675949:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102293376 00000100:00100000:1.0:1788941155.675953:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102293376 00000100:00100000:1.0:1788941155.675978:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788941155.675985:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:22693:x1875840102293376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941155.676058:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:22693:x1875840102293376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941155.676064:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788941155.676100:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102293376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788941155.676780:0:23915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788941155.676865:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788941155.676881:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788941155.676889:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941155.676898:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941156.164034:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788941156.741294:0:23449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788941157.188391:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941158.213332:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941159.242572:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941159.812543:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788941159.812567:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102293632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941159.812650:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941159.812729:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102293632 00000100:00100000:2.0:1788941159.812737:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102293632 00000100:00100000:2.0:1788941159.812786:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788941159.812810:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102293632:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941159.813248:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102293504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941159.813323:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941159.813394:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102293504 00000100:00100000:3.0:1788941159.813415:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102293504 00000100:00100000:3.0:1788941159.813457:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788941159.813465:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102293504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788941159.813489:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788941159.813577:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102293504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941159.813595:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788941159.813664:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102293504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941159.815861:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102293760:0@lo:400:kworker.0 00000100:00100000:3.0:1788941159.815932:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788941159.816036:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941159.816047:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941159.816050:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941159.816053:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941159.816075:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941159.816079:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941159.816082:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941159.816085:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00000024:2.0:1788941159.816157:0:22702:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788941159.816877:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102293760 00000100:00100000:0.0:1788941159.816886:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102293760 00000100:00100000:0.0:1788941159.816951:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788941159.816962:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:3652:x1875840102293760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941159.817404:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:3652:x1875840102293760:12345-0@lo:400:kworker.0 Request processed in 444us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941159.817408:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102293632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4599us (4758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941159.817412:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788941159.817416:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788941159.817461:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102293888:0@lo:400:kworker.0 00000100:00100000:0.0:1788941159.817496:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941159.817531:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941159.817539:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102294016:0@lo:400:kworker.0 00000100:00100000:0.0:1788941159.817562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941159.817644:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102293760:0@lo:400:kworker.0 00000100:00100000:3.0:1788941159.817669:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102293632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941159.817725:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102293888 00000100:00100000:1.0:1788941159.817731:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102293888 00000100:00100000:0.0:1788941159.818038:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102294016 00000100:00100000:0.0:1788941159.818107:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102294016 00000100:00100000:1.0:1788941159.818137:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941159.818169:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102293888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941159.818303:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102293888:12345-0@lo:400:kworker.0 Request processed in 138us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941159.818331:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941159.818346:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941159.818351:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102294016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941159.818399:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102294016:12345-0@lo:400:kworker.0 Request processed in 48us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941159.818416:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788941159.818576:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cac8596d80 x1875840102294016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941159.818607:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102294016:0@lo:400:kworker.0 00010000:00080000:3.0:1788941159.818627:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cac8596a00 x1875840102293888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941159.818648:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102293888:0@lo:400:kworker.0 00010000:00010000:0.0:1788941160.260056:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788941160.517258:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788941161.015305:0:24198:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788941161.015310:0:24198:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788941161.015312:0:24198:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788941161.015541:0:24198:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cbc460a800 00000020:01000004:3.0:1788941161.015562:0:24198:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788941161.015579:0:24198:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788941161.015593:0:24198:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99cbfd8099c0) 00000020:00000080:3.0:1788941161.015613:0:24198:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788941161.104514:0:24198:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788941161.115667:0:24198:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788941161.116079:0:24198:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788941161.116531:0:24198:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788941161.119340:0:24198:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788941161.119884:0:24198:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788941161.121029:0:24198:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788941161.126385:0:24198:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788941161.126626:0:24198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788941161.126645:0:24198:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788941161.126674:0:24198:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24b6539075b3edd3 00000020:01000004:3.0:1788941161.126682:0:24198:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788941161.126706:0:24198:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788941161.126710:0:24198:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788941161.126717:0:24198:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788941161.126722:0:24198:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788941161.126733:0:24198:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99cbfd808000) 00000020:00000080:3.0:1788941161.126744:0:24198:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788941161.127931:0:24198:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788941161.128129:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788941161.128137:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788941161.138001:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788941161.138025:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788941161.138612:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788941161.138619:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788941161.141572:0:24198:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788941161.141752:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788941161.141759:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788941161.143093:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788941161.143104:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788941161.206473:0:24198:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788941161.206721:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788941161.206728:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788941161.214054:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788941161.215995:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788941161.222340:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788941161.222360:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788941161.224958:0:24198:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941161.225165:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788941161.225172:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788941161.230378:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788941161.230395:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1788941161.285323:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941161.340445:0:24198:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788941161.340690:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788941161.340697:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788941161.346562:0:24198:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788941161.346582:0:24198:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788941161.349686:0:24198:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788941161.349722:0:24198:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788941161.349730:0:24198:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788941161.373695:0:24198:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788941161.373749:0:24198:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788941161.373754:0:24198:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788941161.373755:0:24198:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788941161.373757:0:24198:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941161.373758:0:24198:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941161.373760:0:24198:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941161.373761:0:24198:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941161.373762:0:24198:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941161.373764:0:24198:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941161.373766:0:24198:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788941161.373769:0:24198:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788941161.373772:0:24198:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788941161.373773:0:24198:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788941161.373774:0:24198:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941161.373775:0:24198:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941161.373776:0:24198:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941161.373778:0:24198:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941161.373784:0:24198:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941161.373785:0:24198:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941161.373786:0:24198:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788941161.373827:0:24198:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788941161.374330:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788941161.374405:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.374486:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcbcfa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941161.380299:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102294144 00000100:00100000:0.0:1788941161.380316:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102294144 00000100:00100000:0.0:1788941161.380386:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788941161.380397:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:24198:x1875840102294144:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788941161.380460:0:22688:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788941161.380464:0:22688:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788941161.380469:0:22688:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788941161.381404:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:24198:x1875840102294144:12345-0@lo:253:mount.lustre.0 Request processed in 1005us (6994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941161.381415:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788941161.381519:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294144:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788941161.381537:0:24198:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788941161.381540:0:24198:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788941161.381542:0:24198:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788941161.381543:0:24198:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941161.381544:0:24198:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941161.381545:0:24198:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941161.381546:0:24198:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941161.381548:0:24198:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941161.381550:0:24198:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941161.381551:0:24198:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788941161.381575:0:24198:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cbc460a800 from lustre-OST0000 10000000:01000000:3.0:1788941161.381607:0:24198:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788941161.381609:0:24198:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788941161.381618:0:24198:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cbf93a3380 local copy 00010000:00010000:3.0:1788941161.381628:0:24198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941161.381748:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941161.381788:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.381827:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc539e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788941161.382174:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102294272 00000100:00100000:0.0:1788941161.382192:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102294272 00000100:00100000:0.0:1788941161.382237:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788941161.382246:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:24198:x1875840102294272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941161.382346:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:24198:x1875840102294272:12345-0@lo:501:mount.lustre.0 Request processed in 101us (557us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788941161.382363:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788941161.382552:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294272:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788941161.382571:0:24198:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788941161.382591:0:24198:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788941161.382604:0:24198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.382614:0:24198:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941161.382641:0:24198:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cbc460a800 10000000:01000000:3.0:1788941161.382646:0:24198:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788941161.382652:0:24198:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788941161.382654:0:24198:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788941161.382658:0:24198:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788941161.382661:0:24198:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788941161.382687:0:24198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40000/0x24b6539075b3ede1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.382694:0:24198:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f40000/0x24b6539075b3ede1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.382704:0:24198:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f40000/0x24b6539075b3ede1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941161.382718:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941161.382747:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.382780:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc539e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788941161.382859:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102294400 00000100:00100000:1.0:1788941161.382864:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102294400 00000100:00100000:1.0:1788941161.383091:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788941161.383100:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+18:24198:x1875840102294400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941161.383110:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941161.383124:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac19a4600/0x24b6539075b3ede8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ede1 expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941161.383147:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac19a4600/0x24b6539075b3ede8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ede1 expref: 19 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941161.383157:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac19a4600/0x24b6539075b3ede8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ede1 expref: 19 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941161.383165:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac19a4600, rc 0) 00000100:00100000:1.0:1788941161.383214:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294400:12345-0@lo:101:mount.lustre.0 Request processed in 116us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941161.383220:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788941161.383507:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941161.383522:0:24198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f40000/0x24b6539075b3ede1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ede8 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.383530:0:24198:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f40000/0x24b6539075b3ede1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ede8 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788941161.385060:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788941161.390397:0:24198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788941161.393403:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788941161.393464:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788941161.393483:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788941161.393658:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788941161.393679:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788941161.393696:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788941161.393712:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788941161.393727:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788941161.393742:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788941161.393757:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788941161.393773:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788941161.393787:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788941161.393815:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788941161.393822:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788941161.394374:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941161.394445:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941161.394493:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03840 going to sleep for 11 seconds 00000100:00100000:2.0:1788941161.394629:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102294528 00000100:00100000:2.0:1788941161.394639:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102294528 00000100:00100000:2.0:1788941161.394690:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788941161.394700:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941161.394872:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294528:12345-0@lo:501:mount.lustre.0 Request processed in 174us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.395250:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788941161.395367:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941161.395408:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941161.395460:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941161.395547:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03840 going to sleep for 11 seconds 00000100:00100000:1.0:1788941161.401330:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102294656 00000100:00100000:1.0:1788941161.401346:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102294656 00000100:00100000:1.0:1788941161.401432:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788941161.401445:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941161.405756:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294656:12345-0@lo:503:mount.lustre.0 Request processed in 4306us (10286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941161.405771:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788941161.414090:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294656:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788941161.415347:0:24198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788941161.415465:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941161.416727:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941161.417151:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03840 going to sleep for 11 seconds 00000100:00100000:2.0:1788941161.426092:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102294784 00000100:00100000:2.0:1788941161.426110:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102294784 00000100:00100000:2.0:1788941161.426190:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788941161.426203:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.427007:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294784:12345-0@lo:502:mount.lustre.0 Request processed in 804us (10281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.427018:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788941161.427372:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941161.427622:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788941161.427656:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788941161.427670:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788941161.427683:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788941161.427695:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788941161.427709:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788941161.427720:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788941161.427733:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788941161.427745:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788941161.427757:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788941161.427774:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788941161.427788:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788941161.427830:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941161.428362:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941161.428397:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03840 going to sleep for 11 seconds 00000100:00100000:2.0:1788941161.429107:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102294912 00000100:00100000:2.0:1788941161.429126:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102294912 00000100:00100000:2.0:1788941161.429178:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788941161.429298:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.429421:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102294912:12345-0@lo:502:mount.lustre.0 Request processed in 125us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941161.429486:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102294912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941161.429564:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788941161.429576:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788941161.435154:0:24215:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788941161.435169:0:24215:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788941161.435176:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941161.435190:0:24215:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788941161.435197:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941161.435214:0:24215:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99cbfdb6b380) 00000020:00000080:1.0:1788941161.435241:0:24215:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788941161.435247:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788941161.435326:0:24215:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc460a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788941161.435336:0:24215:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788941161.435344:0:24215:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24b6539075b3edf6 00000100:00100000:2.0:1788941161.440320:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1788941161.453512:0:24215:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788941161.456111:0:24215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788941161.464430:0:24215:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788941161.479850:0:24215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788941161.479866:0:24215:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941161.479875:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.479877:0:24215:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788941161.479881:0:24215:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788941161.479884:0:24215:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788941161.479886:0:24215:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941161.479887:0:24215:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941161.479889:0:24215:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788941161.479891:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.479893:0:24215:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788941161.479967:0:24215:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941161.479975:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.479976:0:24215:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788941161.479981:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788941161.479983:0:24215:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788941161.479985:0:24215:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941161.479988:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.479989:0:24215:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788941161.479991:0:24215:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941161.479993:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.479994:0:24215:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788941161.479997:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788941161.480030:0:24215:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941161.480033:0:24215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.480035:0:24215:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788941161.480038:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788941161.481276:0:24198:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788941161.481322:0:24198:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788941161.481353:0:24198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40000/0x24b6539075b3ede1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ede8 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.481366:0:24198:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f40000/0x24b6539075b3ede1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ede8 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941161.481374:0:24198:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cbc460a800 from 1 10000000:01000000:2.0:1788941161.481377:0:24198:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788941161.481415:0:24198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.481423:0:24198:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.481434:0:24198:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941161.481459:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788941161.482314:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.482359:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc6c74540 going to sleep for 11 seconds 00000100:00100000:0.0:1788941161.482613:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102295040 00000100:00100000:0.0:1788941161.482622:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102295040 00000100:00100000:0.0:1788941161.482717:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788941161.482728:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102295040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941161.482745:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941161.482763:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3edfd expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941161.482789:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3edfd expref: 20 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941161.482811:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3edfd expref: 20 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941161.482821:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09a200, rc 0) 00000100:00100000:0.0:1788941161.482895:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295040:12345-0@lo:101:mount.lustre.0 Request processed in 169us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941161.482912:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788941161.482995:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941161.483019:0:24198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.483029:0:24198:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788941161.492357:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788941161.492698:0:24198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941161.492964:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788941161.492991:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788941161.493006:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788941161.493022:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788941161.493038:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788941161.493049:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788941161.493060:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788941161.493071:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788941161.493082:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788941161.493111:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788941161.493126:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788941161.493144:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788941161.493149:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788941161.493434:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941161.493993:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.496145:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac1397c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788941161.496349:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102295168 00000100:00100000:3.0:1788941161.496360:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102295168 00000100:00100000:3.0:1788941161.496413:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788941161.496423:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941161.496613:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295168:12345-0@lo:501:mount.lustre.0 Request processed in 192us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.496621:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788941161.499374:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941161.499444:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788941161.499542:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.499588:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac1397c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788941161.500334:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102295296 00000100:00100000:3.0:1788941161.500343:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102295296 00000100:00100000:3.0:1788941161.500393:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788941161.500401:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941161.500542:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295296:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.500550:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788941161.501374:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788941161.501886:0:24198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788941161.503108:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.504006:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.504051:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc333e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788941161.504164:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102295424 00000100:00100000:3.0:1788941161.504174:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102295424 00000100:00100000:3.0:1788941161.504238:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788941161.504248:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941161.504407:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295424:12345-0@lo:502:mount.lustre.0 Request processed in 160us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.504415:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788941161.504692:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941161.505069:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788941161.505101:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788941161.505116:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788941161.505129:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788941161.505142:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788941161.505155:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788941161.505168:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788941161.505983:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788941161.506016:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788941161.506030:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788941161.506044:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788941161.506104:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.506170:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.506678:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc333e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788941161.514078:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102295552 00000100:00100000:1.0:1788941161.514095:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102295552 00000100:00100000:1.0:1788941161.514194:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788941161.514206:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941161.514449:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295552:12345-0@lo:502:mount.lustre.0 Request processed in 245us (8278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941161.514458:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788941161.515449:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941161.515573:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788941161.515590:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788941161.518658:0:24219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941161.518672:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.518674:0:24219:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788941161.518682:0:24219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbc460a800 00000020:00000080:3.0:1788941161.518684:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788941161.518694:0:24219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941161.518696:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.518710:0:24219:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788941161.518714:0:24219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941161.518716:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.518718:0:24219:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788941161.518721:0:24219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbc460a800 00000020:00000080:3.0:1788941161.518723:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788941161.518794:0:24219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941161.518798:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.518811:0:24219:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788941161.518814:0:24219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941161.518817:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.518818:0:24219:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788941161.518822:0:24219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cbc460a800 00000020:00000080:3.0:1788941161.518824:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788941161.518870:0:24219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941161.518873:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.518874:0:24219:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788941161.518876:0:24219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941161.518878:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.518879:0:24219:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788941161.518882:0:24219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cbc460a800 00000020:00000080:3.0:1788941161.518884:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788941161.518918:0:24219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941161.518922:0:24219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941161.518923:0:24219:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788941161.518926:0:24219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788941161.519127:0:24198:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788941161.519156:0:24198:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788941161.519186:0:24198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.519199:0:24198:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941161.519250:0:24198:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788941161.519259:0:24198:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cbc460a800 10000000:01000000:2.0:1788941161.519262:0:24198:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cbc460a800 10000000:01000000:2.0:1788941161.519266:0:24198:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788941161.519272:0:24198:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cbc460a800 from 1 10000000:01000000:2.0:1788941161.519274:0:24198:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788941161.519320:0:24198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3ee0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.519330:0:24198:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3ee0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.519341:0:24198:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3ee0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941161.519365:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788941161.519429:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.519469:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102295680 00000100:00100000:2.0:1788941161.519476:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102295680 00000100:00100000:2.0:1788941161.519529:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788941161.519538:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:24198:x1875840102295680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941161.519551:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941161.519562:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec4a00/0x24b6539075b3ee12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ee0b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.519584:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec4a00/0x24b6539075b3ee12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ee0b expref: 21 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.519594:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec4a00/0x24b6539075b3ee12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ee0b expref: 21 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.519611:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4a00, rc 0) 00000100:00100000:2.0:1788941161.519644:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102295680:12345-0@lo:101:mount.lustre.0 Request processed in 107us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.519651:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788941161.519694:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc333e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941161.519713:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941161.519727:0:24198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3ee0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee12 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.519736:0:24198:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3ee0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ee12 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788941161.523663:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788941161.525766:0:24198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941161.530689:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788941161.530728:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788941161.530764:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788941161.530781:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788941161.530796:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788941161.530810:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788941161.530824:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788941161.530856:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788941161.530873:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788941161.530887:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788941161.530901:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788941161.530927:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788941161.530940:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788941161.530952:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788941161.530977:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788941161.530992:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788941161.531005:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788941161.531017:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788941161.531043:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788941161.531058:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788941161.531069:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788941161.531080:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788941161.531091:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788941161.531103:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788941161.531114:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788941161.531125:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788941161.531135:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788941161.531147:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788941161.531160:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788941161.531172:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788941161.531184:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788941161.531196:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788941161.531209:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788941161.531225:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788941161.531252:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788941161.531266:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788941161.531278:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788941161.536376:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788941161.536391:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788941161.536403:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788941161.536415:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788941161.536429:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788941161.536442:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788941161.536455:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788941161.536468:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788941161.536480:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788941161.536492:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788941161.536532:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788941161.536703:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788941161.536746:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788941161.536768:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788941161.536774:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788941161.537370:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941161.537443:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.538319:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102295808 00000100:00100000:2.0:1788941161.538328:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102295808 00000100:00100000:2.0:1788941161.538378:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788941161.538387:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102295808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941161.539641:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102295808:12345-0@lo:501:mount.lustre.0 Request processed in 1249us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.539652:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788941161.539722:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac13976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941161.539748:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941161.539800:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788941161.539869:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.539899:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac13976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941161.540004:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102295936 00000100:00100000:0.0:1788941161.540010:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102295936 00000100:00100000:0.0:1788941161.540049:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788941161.540058:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102295936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941161.540154:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102295936:12345-0@lo:503:mount.lustre.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941161.540160:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788941161.541126:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102295936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788941161.546994:0:24198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788941161.547116:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102296064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.548637:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.548686:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102296064 00000100:00100000:2.0:1788941161.548696:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102296064 00000100:00100000:2.0:1788941161.548745:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788941161.548756:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102296064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.550134:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102296064:12345-0@lo:502:mount.lustre.0 Request processed in 1374us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.550145:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788941161.552641:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac13976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941161.552679:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102296064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941161.553124:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788941161.553155:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788941161.553171:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788941161.553714:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788941161.553734:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788941161.553747:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788941161.553758:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788941161.553770:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788941161.553784:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788941161.553797:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788941161.553811:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788941161.553825:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788941161.553855:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788941161.553889:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788941161.553916:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788941161.553933:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788941161.553947:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788941161.553960:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788941161.553973:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788941161.553986:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788941161.554008:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788941161.554022:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788941161.554033:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788941161.554044:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788941161.554055:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788941161.554077:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788941161.554088:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788941161.554099:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788941161.554110:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788941161.554133:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788941161.554146:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788941161.554160:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788941161.554172:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788941161.554198:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788941161.554213:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788941161.554228:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788941161.554241:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788941161.554253:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788941161.554265:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788941161.554276:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788941161.554301:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788941161.554313:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788941161.554324:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788941161.554334:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788941161.554345:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788941161.554371:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788941161.554385:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788941161.554397:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788941161.554452:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102296192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.554540:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.554586:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac13976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941161.556352:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102296192 00000100:00100000:0.0:1788941161.556365:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102296192 00000100:00100000:0.0:1788941161.556419:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788941161.556428:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102296192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941161.556570:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102296192:12345-0@lo:502:mount.lustre.0 Request processed in 142us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941161.556577:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788941161.559587:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102296192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941161.559887:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788941161.560312:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788941161.560359:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102296320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.560443:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941161.560559:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102296320 00000100:00100000:2.0:1788941161.560568:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102296320 00000100:00100000:2.0:1788941161.560627:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788941161.560636:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102296320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941161.560756:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102296320:12345-0@lo:502:mount.lustre.0 Request processed in 120us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.560763:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788941161.560816:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac13976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941161.560856:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102296320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941161.560901:0:24198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788941161.561113:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788941161.579664:0:24224:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788941161.579685:0:24224:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99cbf9394d40) 00000020:00000080:2.0:1788941161.579710:0:24224:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788941161.579823:0:24224:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc460a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788941161.579828:0:24224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbc460a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788941161.579831:0:24224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbc460a800 3 00010000:00080000:2.0:1788941161.579927:0:24224:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbca6ab800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788941161.626762:0:24224:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788941161.635450:0:24224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788941161.635499:0:24224:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788941161.635514:0:24224:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x24b6539075b3ee20 00000100:00080000:2.0:1788941161.635527:0:24224:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788941161.635541:0:24224:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbca6ab800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941161.635586:0:24224:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfea7d500 x1875840102296448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941161.635618:0:24224:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788941161.639321:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875840102296448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941161.639398:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941161.639470:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102296448 00000100:00100000:0.0:1788941161.639478:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102296448 00000100:00100000:0.0:1788941161.639536:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788941161.639543:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875840102296448:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788941161.639576:0:22697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 770 last 0 00000020:00000080:0.0:1788941161.639615:0:22697:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x24b6539075b3ee27 00000004:00100000:0.0:1788941161.639630:0:22697:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788941161.639665:0:22697:0:(import.c:65:import_set_state_nolock()) ffff99cbf6220800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941161.639713:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875840102296448:12345-0@lo:38:llog_process_th.0 Request processed in 169us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941161.639720:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788941161.639761:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cbfea7d500 x1875840102296448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941161.639771:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788941161.639778:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788941161.639785:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788941161.639789:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788941161.639792:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbca6ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788941161.639798:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875840102296448:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788941161.645804:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941161.645813:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941161.645816:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941161.645818:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941161.645895:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941161.645899:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941161.645902:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941161.645904:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788941161.648397:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102296576:0@lo:400:kworker.0 00000100:00100000:3.0:1788941161.648481:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.648530:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788941161.648538:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102296704:0@lo:400:kworker.0 00000100:00100000:3.0:1788941161.648565:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.648608:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102296832:0@lo:400:kworker.0 00000100:00100000:3.0:1788941161.648633:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.648652:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788941161.648659:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102296960:0@lo:400:kworker.0 00000100:00100000:3.0:1788941161.648682:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.648955:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102296704 00000100:00100000:3.0:1788941161.648964:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102296704 00000100:00100000:2.0:1788941161.650310:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102296576 00000100:00100000:2.0:1788941161.650322:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102296576 00000100:00100000:2.0:1788941161.650363:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102296832 00000100:00100000:2.0:1788941161.650367:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102296832 00000100:00100000:2.0:1788941161.650384:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788941161.650393:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102296576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941161.650478:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102296576:12345-0@lo:400:kworker.0 Request processed in 87us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.650487:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788941161.650505:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788941161.650512:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102296832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941161.650546:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102296832:12345-0@lo:400:kworker.0 Request processed in 35us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.650553:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788941161.654333:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102296960 00000100:00100000:3.0:1788941161.654345:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102296960 00000100:00100000:3.0:1788941161.654381:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788941161.654391:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102296704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941161.654482:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102296704:12345-0@lo:400:kworker.0 Request processed in 92us (5915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.654489:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788941161.654506:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788941161.654513:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102296960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941161.654558:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102296960:12345-0@lo:400:kworker.0 Request processed in 46us (5875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.654564:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788941161.654617:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cc01b86680 x1875840102296704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941161.654632:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102296704:0@lo:400:kworker.0 00000100:00100000:3.0:1788941161.654645:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102296576:0@lo:400:kworker.0 00010000:00080000:3.0:1788941161.654676:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cc01b87800 x1875840102296960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941161.654685:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102296960:0@lo:400:kworker.0 00000100:00100000:3.0:1788941161.654695:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102296832:0@lo:400:kworker.0 00000020:01000004:2.0:1788941161.660294:0:24224:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788941161.660317:0:24224:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99cbf9393380) 00000020:00000080:2.0:1788941161.660347:0:24224:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788941161.660458:0:24224:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc460a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788941161.660462:0:24224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbc460a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788941161.660465:0:24224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbc460a800 3 00010000:00080000:2.0:1788941161.660496:0:24224:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbfed2f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788941161.669016:0:24224:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788941161.675740:0:24224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788941161.675796:0:24224:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788941161.675811:0:24224:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x24b6539075b3ee35 00000100:00080000:1.0:1788941161.675823:0:24224:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788941161.675857:0:24224:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99cbfed2f800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788941161.675895:0:24224:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8594e00 x1875840102297088/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941161.675937:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875840102297088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788941161.676006:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941161.676068:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102297088 00000100:00100000:1.0:1788941161.676075:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102297088 00000100:00100000:1.0:1788941161.676106:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788941161.676113:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875840102297088:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788941161.676138:0:22696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 770 last 0 00000020:00000080:1.0:1788941161.676194:0:22696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x24b6539075b3ee3c 00000004:00100000:1.0:1788941161.676208:0:22696:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788941161.676238:0:22696:0:(import.c:65:import_set_state_nolock()) ffff99cbc4675800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941161.676303:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875840102297088:12345-0@lo:38:llog_process_th.0 Request processed in 188us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941161.676310:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788941161.676351:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cac8594e00 x1875840102297088/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941161.676360:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941161.676367:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788941161.676373:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788941161.676377:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788941161.676386:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfed2f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788941161.676391:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875840102297088:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788941161.676409:0:24224:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788941161.676430:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941161.676435:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941161.676438:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941161.676440:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941161.676443:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941161.676446:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941161.676449:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941161.676451:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788941161.679134:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788941161.679295:0:24198:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788941161.679327:0:24198:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788941161.679351:0:24198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3ee0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee12 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941161.679364:0:24198:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5000/0x24b6539075b3ee0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee12 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788941161.679411:0:24198:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788941161.679417:0:24198:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788941161.679418:0:24198:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941161.679420:0:24198:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941161.679421:0:24198:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941161.679423:0:24198:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941161.679424:0:24198:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788941161.679426:0:24198:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941161.679428:0:24198:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788941161.679433:0:24198:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788941161.679435:0:24198:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788941161.679437:0:24198:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788941161.679438:0:24198:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941161.679439:0:24198:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941161.679440:0:24198:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941161.679442:0:24198:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941161.679443:0:24198:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788941161.679444:0:24198:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941161.679445:0:24198:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788941161.679471:0:24198:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788941161.679490:0:24198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102297216:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788941161.679561:0:24198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941161.679605:0:24198:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfecd3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788941161.680084:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102297216 00000100:00100000:2.0:1788941161.680093:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102297216 00000100:00100000:2.0:1788941161.680138:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788941161.680148:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:24198:x1875840102297216:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788941161.680175:0:22691:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788941161.680189:0:22691:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788941161.685242:0:22691:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788941161.685266:0:22691:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788941161.685370:0:22712:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788941161.685376:0:22712:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788941161.685397:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.685416:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 21 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.685424:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 21 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.685430:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.685474:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 21 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.685501:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 21 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941161.685516:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102297344:0@lo:104: 00000100:00100000:3.0:1788941161.685585:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941161.685641:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 21 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.685649:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 21 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941161.685658:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102297472:0@lo:104: 00000100:00100000:3.0:1788941161.685686:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.685702:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf69a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788941161.685728:0:22680:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788941161.685744:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102297344 00000100:00100000:3.0:1788941161.685752:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102297344 00000100:00100000:3.0:1788941161.685786:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102297472 00000100:00100000:3.0:1788941161.685789:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102297472 00000100:00100000:3.0:1788941161.685803:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941161.685812:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:22712:x1875840102297344:12345-0@lo:104: 00010000:00010000:3.0:1788941161.685825:0:22680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.685900:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788941161.685906:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:22712:x1875840102297344:12345-0@lo:104: Request processed in 95us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.685913:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941161.685938:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941161.685944:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac17cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:22712:x1875840102297472:12345-0@lo:104: 00010000:00010000:3.0:1788941161.685952:0:22680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.685983:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788941161.685988:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac17cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:22712:x1875840102297472:12345-0@lo:104: Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.685994:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941161.686054:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102297344:0@lo:104: 00000100:00100000:3.0:1788941161.686062:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102297472:0@lo:104: 00010000:00010000:3.0:1788941161.686077:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686092:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941161.686098:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686104:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09b400 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941161.686108:0:22684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686117:0:22684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941161.686124:0:22684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941161.686129:0:22684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788941161.686162:0:22684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686169:0:22684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941161.686187:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686194:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b400/0x24b6539075b3ed94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed9b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686207:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941161.686211:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686216:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41c00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:3.0:1788941161.686218:0:22684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686225:0:22684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941161.686231:0:22684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941161.686236:0:22684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788941161.686248:0:22684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686253:0:22684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941161.686259:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686275:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7f41c00/0x24b6539075b3ed86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ed8d expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686299:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941161.686300:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941161.686302:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941161.686315:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102297600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941161.686344:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.686373:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788941161.686379:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102297728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941161.686400:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941161.686429:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102297600 00000100:00100000:3.0:1788941161.686433:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102297600 00010000:00010000:3.0:1788941161.686448:0:22682:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 22 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941161.686465:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102297728 00000100:00100000:3.0:1788941161.686467:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102297728 00010000:00010000:3.0:1788941161.686476:0:22682:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 23 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941161.686491:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941161.686497:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:3651:x1875840102297600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941161.686507:0:22682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941161.686512:0:22682:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 23 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686522:0:22682:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 23 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686541:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec4200/0x24b6539075b3ed9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ed94 expref: 23 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686551:0:22682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941161.686579:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:3651:x1875840102297600:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.686585:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941161.686598:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941161.686603:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:3651:x1875840102297728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941161.686610:0:22682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941161.686614:0:22682:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 21 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686622:0:22682:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 21 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686631:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec4400/0x24b6539075b3ed8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ed86 expref: 21 pid: 22691 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686641:0:22682:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686649:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788941161.686660:0:22682:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003076105s 00010000:00010000:3.0:1788941161.686665:0:22682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686682:0:22682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686690:0:22682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686697:0:22682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686701:0:22682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941161.686705:0:22682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686711:0:22682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686723:0:22682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686732:0:22682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941161.686753:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:3651:x1875840102297728:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941161.686759:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941161.686803:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102297728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941161.686811:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102297600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941161.686828:0:22712:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686861:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941161.686874:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f40200/0x24b6539075b3ee43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941161.686957:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941161.687202:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:24198:x1875840102297216:12345-0@lo:253:mount.lustre.0 Request processed in 7054us (7640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941161.687210:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788941161.687422:0:24198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:24198:1875840102297216:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788941161.687433:0:24198:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788941161.687436:0:24198:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788941161.687438:0:24198:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788941161.687440:0:24198:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941161.687441:0:24198:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941161.687442:0:24198:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941161.687444:0:24198:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941161.687445:0:24198:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941161.687447:0:24198:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941161.687448:0:24198:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788941161.687460:0:24198:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788941161.689512:0:24198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788941161.691908:0:24198:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788941161.691917:0:24198:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788941161.691953:0:24198:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788941161.691998:0:24198:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788941161.692017:0:24198:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788941161.692038:0:24198:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788941161.692920:0:24198:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941161.693140:0:24198:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788941162.307987:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788941162.659684:0:24279:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788941162.660165:0:24279:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788941163.332324:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788941163.652117:0:22693:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788941163.652125:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cac84eb800 from 13 10000000:01000000:3.0:1788941163.652130:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788941163.652185:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941163.652197:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941163.652218:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941163.652253:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102297856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788941163.652323:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941163.652422:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcbc32900 going to sleep for 11 seconds 00000100:00100000:1.0:1788941163.655599:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102297856 00000100:00100000:1.0:1788941163.655614:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102297856 00000100:00100000:1.0:1788941163.658421:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788941163.658439:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+19:22693:x1875840102297856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788941163.658458:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941163.658488:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ee4a expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941163.658519:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 20 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941163.658531:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 20 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941163.658551:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac19a5400, rc 0) 00000100:00100000:1.0:1788941163.658646:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:22693:x1875840102297856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (6322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941163.658653:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788941163.659521:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102297856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788941163.659545:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941163.659555:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941163.659621:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102297984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788941163.659665:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941163.659736:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7fa2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788941163.659789:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102297984 00000100:00100000:3.0:1788941163.659796:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102297984 00000100:00100000:3.0:1788941163.659913:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788941163.659923:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:22693:x1875840102297984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788941163.659941:0:22691:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788941163.659958:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788941163.659961:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788941163.660038:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:22693:x1875840102297984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941163.660045:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788941163.660110:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102297984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788941163.660178:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788941163.660185:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941163.660193:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941163.660202:0:22693:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788941163.660205:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cbe5775000 from 13 10000000:01000000:1.0:1788941163.660208:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788941163.660227:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941163.660239:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941163.660259:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941163.660273:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102298112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788941163.660298:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941163.660776:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7fa2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788941163.660915:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102298112 00000100:00100000:0.0:1788941163.660922:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102298112 00000100:00100000:0.0:1788941163.660952:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788941163.660960:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:22693:x1875840102298112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941163.660969:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941163.660980:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ee58 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941163.660998:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 21 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941163.661018:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 21 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941163.661025:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09ae00, rc 0) 00000100:00100000:0.0:1788941163.661064:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102298112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941163.661069:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788941163.661076:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102298112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941163.661087:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941163.661095:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941163.661141:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102298240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788941163.661172:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941163.661186:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cc002033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941163.661198:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102298240 00000100:00100000:2.0:1788941163.661201:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102298240 00000100:00100000:2.0:1788941163.661220:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788941163.661226:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102298240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788941163.661255:0:22689:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788941163.661267:0:22689:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788941163.661269:0:22689:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788941163.662551:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102298240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1319us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941163.662560:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788941163.665016:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102298240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788941163.665107:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788941163.665118:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941163.665131:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941164.356326:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941164.936991:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102298368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941164.937066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941164.937164:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102298368 00000100:00100000:1.0:1788941164.937173:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102298368 00000100:00100000:1.0:1788941164.937263:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788941164.937273:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102298368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941164.937305:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941164.937350:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102298368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941164.937358:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788941164.937507:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102298368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941164.937690:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788941164.937700:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102298496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941164.937727:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941164.937864:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102298496 00000100:00100000:1.0:1788941164.937869:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102298496 00000100:00100000:1.0:1788941164.937900:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788941164.937907:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102298496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941164.938030:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941164.938079:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102298496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941164.938085:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788941164.938178:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102298496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788941165.381033:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941166.404351:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788941166.979982:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941166.980000:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941166.980003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941166.980006:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941166.980031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941166.980035:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941166.980038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941166.980041:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941166.980077:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102299008:0@lo:400:kworker.0 00000100:00100000:1.0:1788941166.980137:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941166.980172:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788941166.980177:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102298880:0@lo:400:kworker.0 00000100:00100000:1.0:1788941166.980211:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941166.980229:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875840102299392:0@lo:400:kworker.0 00000100:00100000:1.0:1788941166.980250:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941166.980285:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102298880 00000100:00100000:1.0:1788941166.980294:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102298880 00000100:00100000:1.0:1788941166.980334:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102299392 00000100:00100000:1.0:1788941166.980337:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102299392 00000100:00100000:1.0:1788941166.980372:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788941166.980384:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102298880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941166.980440:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102298880:12345-0@lo:400:kworker.0 Request processed in 57us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941166.980448:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788941166.980466:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788941166.980480:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875840102299392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941166.980508:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875840102299392:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941166.980514:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788941166.980557:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cac8597480 x1875840102298880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941166.980572:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102298880:0@lo:400:kworker.0 00010000:00080000:1.0:1788941166.980583:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cac8596a00 x1875840102299392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941166.980590:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875840102299392:0@lo:400:kworker.0 00000100:00080000:1.0:1788941166.980640:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788941166.981128:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102298624:0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.981166:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941166.981204:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875840102299136:0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.981226:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941166.981247:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788941166.981253:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102298752:0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.981275:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941166.981290:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102299264:0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.981310:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941166.981343:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102299008 00000100:00100000:3.0:1788941166.981347:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102299008 00000100:00100000:3.0:1788941166.981372:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102298752 00000100:00100000:3.0:1788941166.981374:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102298752 00000100:00100000:3.0:1788941166.981387:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788941166.981392:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102299008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.981428:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102299008:12345-0@lo:400:kworker.0 Request processed in 35us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941166.981434:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788941166.981446:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788941166.981451:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102298752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.981474:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102298752:12345-0@lo:400:kworker.0 Request processed in 23us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941166.981479:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:00080000:3.0:1788941166.982530:0:23449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788941166.982612:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102298624 00000100:00100000:3.0:1788941166.982620:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102298624 00000100:00100000:3.0:1788941166.983017:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788941166.983047:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:3651:x1875840102298624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.983129:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:3651:x1875840102298624:12345-0@lo:400:kworker.0 Request processed in 85us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941166.983136:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788941166.985924:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102299136 00000100:00100000:2.0:1788941166.986005:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102299136 00000100:00100000:2.0:1788941166.986063:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102299264 00000100:00100000:2.0:1788941166.986067:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102299264 00000100:00100000:2.0:1788941166.986099:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788941166.986111:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875840102299136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941166.986217:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875840102299136:12345-0@lo:400:kworker.0 Request processed in 109us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941166.986225:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788941166.986245:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788941166.986251:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875840102299264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941166.986280:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875840102299264:12345-0@lo:400:kworker.0 Request processed in 29us (4968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941166.986287:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788941166.986304:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788941166.987145:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102298752:0@lo:400:kworker.0 00010000:00080000:3.0:1788941166.987163:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cac8595f80 x1875840102299264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941166.987173:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102299264:0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.987194:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102298624:0@lo:400:kworker.0 00010000:00080000:3.0:1788941166.987207:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cac8595880 x1875840102299136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941166.987215:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875840102299136:0@lo:400:kworker.0 00000100:00100000:3.0:1788941166.987262:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102299008:0@lo:400:kworker.0 00010000:00010000:3.0:1788941167.428097:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788941168.017725:0:24570:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788941168.452721:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788941169.171210:0:24622:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788941169.171525:0:24622:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788941169.477319:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941169.866911:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941154/real 1788941154] req@ffff99cbc9a32680 x1875840102292352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941169 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941169.866943:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cbc9a32680 x1875840102292352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941169 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941169.866953:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941154/real 1788941154] req@ffff99cbc9a30700 x1875840102292480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941169 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941169.866963:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cbc9a30700 x1875840102292480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941169 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788941169.866982:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac5a58800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941169.867003:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788941169.867007:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102292352:0@lo:8:kworker.0 00000100:00080000:0.0:1788941169.867012:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941169.867017:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788941169.867020:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102292480:0@lo:8:kworker.0 00000100:00080000:3.0:1788941169.867187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941169.867192:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941169.867195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941169.867198:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941169.867225:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941169.867228:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788941169.867231:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cac5a58800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941169.867236:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 763 00000100:00080000:3.0:1788941169.867242:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788941169.867254:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cac5a58800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941169.867273:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b85180 x1875840102300032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941169.867287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941169.867291:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788941169.867292:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941169.867295:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 763 00000100:00080000:3.0:1788941169.867298:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788941169.867303:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99cbfda41800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941169.867316:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cc01b84e00 x1875840102300160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788941169.867360:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102299648:0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.867450:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941169.867491:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102300416:0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.867517:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941169.867540:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788941169.867545:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102299776:0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.867564:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941169.867581:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102300544:0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.867611:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941169.867640:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102300032:0@lo:8:kworker.0 00000100:00100000:3.0:1788941169.867671:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941169.867692:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102300160:0@lo:8:kworker.0 00000100:00100000:3.0:1788941169.867716:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941169.867744:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102299648 00000100:00100000:3.0:1788941169.867752:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102299648 00000100:00100000:3.0:1788941169.867807:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788941169.867817:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102299648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.867900:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102299648:12345-0@lo:400:kworker.0 Request processed in 84us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941169.867907:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788941169.867932:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102300416 00000100:00100000:3.0:1788941169.867936:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102300416 00000100:00100000:3.0:1788941169.867964:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102299776 00000100:00100000:3.0:1788941169.867967:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102299776 00000100:00100000:3.0:1788941169.867978:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102300544 00000100:00100000:3.0:1788941169.867980:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102300544 00000100:00100000:3.0:1788941169.867994:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788941169.868000:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875840102300416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.868030:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875840102300416:12345-0@lo:400:kworker.0 Request processed in 30us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941169.868036:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788941169.868048:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788941169.868053:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102299776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.868079:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102299776:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941169.868095:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788941169.868106:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788941169.868111:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102300544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.868149:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102300544:12345-0@lo:400:kworker.0 Request processed in 38us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941169.868155:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788941169.868181:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788941169.868184:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788941169.868208:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cc01b86d80 x1875840102299776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941169.868221:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102299776:0@lo:400:kworker.0 00010000:00080000:3.0:1788941169.868231:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e1500 x1875840102300544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941169.868239:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102300544:0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.868247:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102299648:0@lo:400:kworker.0 00010000:00080000:3.0:1788941169.868254:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e2680 x1875840102300416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941169.868261:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102300416:0@lo:400:kworker.0 00000100:00100000:1.0:1788941169.868359:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3650:1875840102299520:0@lo:400:kworker.0 00000100:00100000:1.0:1788941169.868395:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941169.868430:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102300288:0@lo:400:kworker.0 00000100:00100000:1.0:1788941169.868451:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941169.868469:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788941169.868474:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102299904:0@lo:400:kworker.0 00000100:00100000:1.0:1788941169.868492:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941169.868515:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102299904 00000100:00100000:1.0:1788941169.868518:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102299904 00000100:00100000:1.0:1788941169.868540:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788941169.868546:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102299904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941169.868576:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102299904:12345-0@lo:400:kworker.0 Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941169.868581:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788941169.868612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102299904:0@lo:400:kworker.0 00000100:00100000:1.0:1788941169.868625:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102300288 00000100:00100000:1.0:1788941169.868628:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102300288 00000100:00100000:1.0:1788941169.868645:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788941169.868650:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102300288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941169.868679:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102300288:12345-0@lo:400:kworker.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941169.868684:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788941169.868707:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cc01b85c00 x1875840102300288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941169.868716:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102300288:0@lo:400:kworker.0 00000100:00100000:0.0:1788941169.869594:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102300032 00000100:00100000:0.0:1788941169.869610:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102300032 00000100:00100000:0.0:1788941169.870927:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102300160 00000100:00100000:0.0:1788941169.870938:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102300160 00000100:00100000:3.0:1788941169.871906:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102299520 00000100:00100000:3.0:1788941169.871915:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102299520 00000100:00100000:3.0:1788941169.871961:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788941169.871970:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:3650:x1875840102299520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941169.872054:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:3650:x1875840102299520:12345-0@lo:400:kworker.0 Request processed in 86us (3658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941169.872070:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788941169.872453:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941169.872460:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875840102300032:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788941169.872488:0:24205:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 778 last 0 00000020:00000080:1.0:1788941169.872518:0:24205:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b6539075b3ee66 00002000:00100000:1.0:1788941169.872532:0:24205:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99cbc4672000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788941169.872536:0:24205:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788941169.872539:0:24205:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788941169.872715:0:24205:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788941169.872740:0:24205:0:(import.c:65:import_set_state_nolock()) ffff99cbc4671000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941169.872944:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1875840102300032:12345-0@lo:8:kworker.0 Request processed in 482us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941169.872952:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941169.872967:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941169.872972:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875840102300160:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788941169.872992:0:24205:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788941169.873020:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875840102300160:12345-0@lo:8:kworker.0 Request processed in 46us (5302us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788941169.873027:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941169.873071:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3650:1875840102299520:0@lo:400:kworker.0 00010000:00080000:3.0:1788941169.873283:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cc01b85180 x1875840102300032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788941189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941169.873297:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788941169.873304:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788941169.873312:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788941169.873318:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788941169.873320:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac5a58800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788941169.873336:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788941169.873341:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102300032:0@lo:8:kworker.0 00000100:00080000:3.0:1788941169.873355:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788941169.873359:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788941169.873361:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102300160:0@lo:8:kworker.0 00000004:00080000:3.0:1788941169.873389:0:23437:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788941169.876706:0:23437:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 778543867557ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788941169.876725:0:23437:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788941169.878645:0:23438:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788941169.878680:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23438:1875840102300800:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788941169.878760:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941169.878809:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbccd0af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941169.878854:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102300800 00000100:00100000:1.0:1788941169.878861:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102300800 00000100:00100000:1.0:1788941169.878918:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941169.878927:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23438:x1875840102300800:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1788941169.879146:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941169.879267:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788941169.879278:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102300672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941169.879312:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788941169.880277:0:23429:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788941169.880996:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102300672 00000100:00100000:1.0:1788941169.881005:0:24206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102300672 00000100:00100000:1.0:1788941169.881594:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941169.881606:0:24206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875840102300672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788941169.881638:0:24206:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788941169.881731:0:24206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875840102300672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941169.881739:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788941169.881816:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cac8596300 x1875840102300672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788941185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941169.881854:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102300672:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1788941169.882949:0:24205:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788941169.882956:0:24205:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788941169.883025:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23438:x1875840102300800:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4097us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941169.883035:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788941169.884015:0:23438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cac8595880 x1875840102300800/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788941185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941169.884031:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23438:1875840102300800:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788941169.884044:0:23438:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788941169.884092:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23438:1875840102300928:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788941169.884145:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941169.884179:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcbc32000 going to sleep for 11 seconds 00000100:00100000:3.0:1788941169.884231:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102300928 00000100:00100000:3.0:1788941169.884238:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102300928 00000100:00100000:3.0:1788941169.884286:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788941169.884294:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23438:x1875840102300928:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788941169.884321:0:24203:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788941169.884362:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23438:x1875840102300928:12345-0@lo:5:osp-pre-0-1.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941169.884376:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788941169.884423:0:23438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbfeb95c00 x1875840102300928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788941185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941169.884433:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23438:1875840102300928:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788941169.884442:0:23438:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788941169.884466:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23438:1875840102301056:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788941169.884491:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941169.884505:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf69a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788941169.884517:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102301056 00000100:00100000:3.0:1788941169.884521:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102301056 00000100:00100000:3.0:1788941169.884543:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788941169.884549:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23438:x1875840102301056:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788941169.884576:0:24205:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1788941169.942882:0:24199:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788941169.942901:0:24199:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788941169.943238:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23438:x1875840102301056:12345-0@lo:5:osp-pre-0-1.0 Request processed in 58683us (58741us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788941169.943250:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788941169.943322:0:23438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e2680 x1875840102301056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788941185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941169.943336:0:23438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788941169.943342:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23438:1875840102301056:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788941169.943362:0:23438:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788941169.943424:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23438:1875840102301184:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788941169.943466:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941169.943499:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcbc32840 going to sleep for 11 seconds 00000100:00100000:3.0:1788941169.944531:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102301184 00000100:00100000:3.0:1788941169.944545:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102301184 00000100:00100000:3.0:1788941169.944600:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941169.944611:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23438:x1875840102301184:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788941169.944695:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23438:x1875840102301184:12345-0@lo:900:osp-pre-0-1.0 Request processed in 86us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941169.944703:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788941169.944792:0:23438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbfeb95180 x1875840102301184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788941185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941169.944806:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23438:1875840102301184:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788941170.068231:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941170.068259:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102301440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788941170.068340:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941170.068403:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102301440 00000100:00100000:0.0:1788941170.068413:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102301440 00000100:00100000:0.0:1788941170.068470:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788941170.068480:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102301440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788941170.068522:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941170.068579:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102301440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941170.068587:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788941170.068657:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102301440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941170.072184:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102301312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941170.072279:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941170.072347:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102301312 00000100:00100000:3.0:1788941170.072356:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102301312 00000100:00100000:3.0:1788941170.072410:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788941170.072421:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102301312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788941170.072469:0:22702:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788941170.072521:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102301312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941170.072529:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788941170.072583:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102301312:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788941170.250709:0:24672:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788941170.251520:0:24672:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788941170.504225:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788941170.761352:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788941171.525780:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941172.548042:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941173.572341:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941173.956004:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941153/real 1788941153] req@ffff99cbc9a33b80 x1875840102290688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941173 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941173.956043:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cbc9a33b80 x1875840102290688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941173 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941173.956055:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941153/real 1788941153] req@ffff99cbc9a31f80 x1875840102290816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941173 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941173.956080:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cbc9a31f80 x1875840102290816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941173 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788941173.956100:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfc148800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941173.956136:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788941173.956141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102290688:0@lo:8:kworker.0 00000100:00080000:0.0:1788941173.956148:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941173.956153:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788941173.956156:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102290816:0@lo:8:kworker.0 00000100:00080000:3.0:1788941173.956388:0:22101:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941173.956393:0:22101:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788941173.956395:0:22101:0:(import.c:65:import_set_state_nolock()) ffff99cbfc148800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941173.956400:0:22101:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 762 00000100:00080000:3.0:1788941173.956407:0:22101:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788941173.956418:0:22101:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cbfc148800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941173.956438:0:22101:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe56e1180 x1875840102301824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941173.956454:0:22101:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941173.956457:0:22101:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788941173.956459:0:22101:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941173.956462:0:22101:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 762 00000100:00080000:3.0:1788941173.956464:0:22101:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788941173.956468:0:22101:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbfea41000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941173.956488:0:22101:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe56e3100 x1875840102301952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941173.956515:0:22101:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941173.956519:0:22101:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788941173.956521:0:22101:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941173.956524:0:22101:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 778 00000100:00080000:3.0:1788941173.956527:0:22101:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788941173.956532:0:22101:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99cbfda41800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941173.956542:0:22101:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe56e0700 x1875840102302464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788941173.956584:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.956652:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.956706:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102302848:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.956732:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.956754:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788941173.956759:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102301568:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.956788:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.956811:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102302336:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.956853:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.956882:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102301696:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.956907:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.956939:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102302592:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.956961:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.956981:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788941173.956994:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102302080:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957020:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.957037:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875840102302720:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.957096:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102302208 00000100:00100000:3.0:1788941173.957105:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102302208 00000100:00100000:3.0:1788941173.957146:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102301696 00000100:00100000:3.0:1788941173.957150:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102301696 00000100:00100000:3.0:1788941173.957166:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788941173.957174:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102302208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957234:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102302208:12345-0@lo:400:kworker.0 Request processed in 60us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941173.957241:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788941173.957260:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788941173.957267:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102301696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957307:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102301696:12345-0@lo:400:kworker.0 Request processed in 40us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941173.957313:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788941173.957331:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102302848 00000100:00100000:3.0:1788941173.957335:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102302848 00000100:00100000:3.0:1788941173.957365:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102302592 00000100:00100000:3.0:1788941173.957368:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102302592 00000100:00100000:3.0:1788941173.957379:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102302080 00000100:00100000:3.0:1788941173.957381:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102302080 00000100:00100000:3.0:1788941173.957390:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102302720 00000100:00100000:3.0:1788941173.957392:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102302720 00000100:00100000:3.0:1788941173.957406:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788941173.957411:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102302848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957450:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102302848:12345-0@lo:400:kworker.0 Request processed in 38us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941173.957457:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788941173.957469:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788941173.957474:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102302592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941173.957478:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102301696:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957497:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102302592:12345-0@lo:400:kworker.0 Request processed in 23us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941173.957502:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788941173.957512:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788941173.957516:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102302080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957538:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102302080:12345-0@lo:400:kworker.0 Request processed in 22us (518us total) trans 0 rc 0/0 00010000:00080000:2.0:1788941173.957540:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e1880 x1875840102302592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941173.957544:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788941173.957550:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102302592:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957553:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788941173.957558:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875840102302720:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788941173.957563:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e3b80 x1875840102302080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941173.957570:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102302080:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957579:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875840102302720:12345-0@lo:400:kworker.0 Request processed in 21us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941173.957584:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788941173.957586:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e2680 x1875840102302720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941173.957601:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102301568 00000100:00100000:3.0:1788941173.957605:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102301568 00000100:00100000:2.0:1788941173.957613:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875840102302720:0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957627:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788941173.957633:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:3651:x1875840102301568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957661:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:3651:x1875840102301568:12345-0@lo:400:kworker.0 Request processed in 28us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941173.957667:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788941173.957701:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102302336 00000100:00100000:3.0:1788941173.957704:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102302336 00000100:00100000:3.0:1788941173.957742:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788941173.957749:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102302336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941173.957779:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102302336:12345-0@lo:400:kworker.0 Request processed in 31us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941173.957785:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788941173.957814:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788941173.957818:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941173.957820:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788941173.957855:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102301824:0@lo:8:kworker.0 00000100:00100000:3.0:1788941173.957884:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.957910:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102301952:0@lo:8:kworker.0 00000100:00100000:3.0:1788941173.957933:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.957947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102302464:0@lo:8:kworker.0 00000100:00100000:3.0:1788941173.957967:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941173.957988:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102301824 00000100:00100000:3.0:1788941173.957991:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102301824 00000100:00100000:3.0:1788941173.958002:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102301952 00000100:00100000:3.0:1788941173.958005:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102301952 00000100:00100000:2.0:1788941173.958009:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102302464 00000100:00100000:3.0:1788941173.958012:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788941173.958012:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102302464 00000100:00100000:3.0:1788941173.958017:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875840102301824:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788941173.958058:0:24205:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 782 last 0 00000020:00000080:3.0:1788941173.958100:0:24205:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b6539075b3ee6d 00000100:00100000:2.0:1788941173.959547:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102301568:0@lo:400:kworker.0 00010000:00080000:2.0:1788941173.959568:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e3480 x1875840102302336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788941189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941173.959579:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102302336:0@lo:400:kworker.0 00000100:00100000:2.0:1788941173.959590:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102302208:0@lo:400:kworker.0 00010000:00080000:2.0:1788941173.959620:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cc01b84e00 x1875840102302848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941173.959629:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102302848:0@lo:400:kworker.0 00002000:00100000:3.0:1788941173.960373:0:24205:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cac8896000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788941173.960380:0:24205:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788941173.960383:0:24205:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788941173.962115:0:24205:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788941173.962159:0:24205:0:(import.c:65:import_set_state_nolock()) ffff99cac8893000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788941173.962319:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875840102301824:12345-0@lo:8:kworker.0 Request processed in 4297us (4431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941173.962332:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941173.962367:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941173.962373:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875840102301952:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788941173.962395:0:24205:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788941173.962428:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875840102301952:12345-0@lo:8:kworker.0 Request processed in 55us (4495us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788941173.962434:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941173.962446:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788941173.962451:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875840102302464:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788941173.962460:0:24205:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788941173.962484:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875840102302464:12345-0@lo:8:kworker.0 Request processed in 32us (4516us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788941173.962489:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788941173.971387:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e1180 x1875840102301824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788941198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941173.971404:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788941173.971415:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788941173.971426:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788941173.971434:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788941173.971438:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfc148800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788941173.971463:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788941173.971469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102301824:0@lo:8:kworker.0 00000100:00080000:0.0:1788941173.971482:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941173.971485:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788941173.971488:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102301952:0@lo:8:kworker.0 00000100:00080000:0.0:1788941173.971497:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941173.971500:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788941173.971503:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102302464:0@lo:8:kworker.0 00000004:00080000:1.0:1788941173.973122:0:22720:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788941173.973228:0:22720:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782640392983ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788941173.973251:0:22720:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788941173.974293:0:22721:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788941173.974333:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22721:1875840102303104:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788941173.974413:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941173.974444:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc51b9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788941173.974480:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102303104 00000100:00100000:2.0:1788941173.974487:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102303104 00000100:00100000:2.0:1788941173.974548:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788941173.974556:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22721:x1875840102303104:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1788941173.974777:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941173.974788:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788941173.974798:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102302976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788941173.974826:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941173.974900:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102302976 00000100:00100000:2.0:1788941173.974904:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102302976 00000100:00100000:2.0:1788941173.974928:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788941173.974935:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875840102302976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788941173.974952:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941173.975003:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875840102302976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941173.975010:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788941173.975045:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbfea7df80 x1875840102302976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788941189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941173.975072:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102302976:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788941173.995127:0:24204:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788941173.995143:0:24204:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1788941173.995151:0:24204:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000004:00080000:0.0:1788941174.015081:0:22676:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788941174.015655:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.015665:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015686:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.015691:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.015709:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015726:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015736:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015743:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015761:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941174.015772:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941174.015778:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015785:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41c00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941174.015789:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015798:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015812:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015830:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3ee74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.015875:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.015877:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.015879:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941174.023348:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.023364:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.023383:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.023389:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.023396:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.023411:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.023423:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.023431:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.023463:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.023799:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.023808:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.023817:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.023822:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.023831:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.023886:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.023895:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed9e066f/0x24b6539075b3ee7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.023917:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.023919:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.023921:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941174.025129:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.025148:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.025165:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.025170:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.025175:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.025188:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.025199:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.025208:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.025239:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.025443:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.025450:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.025458:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41600 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.025462:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.025481:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.025495:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.025503:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cae88059/0x24b6539075b3ee82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.025520:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.025522:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.025524:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941174.026085:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.026092:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.026102:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.026105:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.026109:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.026119:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.026134:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.026142:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.026202:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788941174.028387:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.028401:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.028417:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.028421:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.028428:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.028443:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.028453:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.028460:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.030286:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941174.030298:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.030311:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40600 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.030316:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.030327:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.030346:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.030366:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee24777/0x24b6539075b3ee89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.030500:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941174.030506:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.030524:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941174.030527:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.030536:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.030548:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.030556:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.030557:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.030559:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.034178:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788941174.034194:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3ee90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.034392:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941174.041022:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.041036:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.041084:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.041089:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.041095:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.041111:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.041122:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.041130:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.041155:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941174.041441:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941174.041449:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.041461:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941174.041465:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.041474:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.041491:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.041498:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ee97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.041514:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.041516:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.041518:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941174.043111:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.043123:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.043140:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.043145:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.043150:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.043164:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.043192:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.043199:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.043260:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941174.044364:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.044375:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.044388:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.044391:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.044396:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.044409:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.044418:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.044424:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.062150:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941174.062168:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.062182:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.062188:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.062201:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.062224:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.062232:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ee9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.062565:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941174.062572:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.062579:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941174.062583:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.062591:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.062604:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.062619:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.062621:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.062623:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941174.066893:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788941174.066910:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3eea5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.071425:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941174.071767:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.071778:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.071797:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.071802:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.071808:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.071823:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.071866:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.071876:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.071898:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.072317:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.072324:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.072346:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.072351:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.072361:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.072379:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.072386:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ee55ec/0x24b6539075b3eeac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.072404:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.072406:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.072408:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941174.075456:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.075471:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.075515:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.075520:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.075528:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.075592:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.075604:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.075629:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.075670:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.076329:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.076356:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.076380:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41c00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.076385:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.076394:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.076448:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.076456:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603fe86a/0x24b6539075b3eeb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.076490:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.076492:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.076494:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941174.076662:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.076668:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.076678:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.076681:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.076686:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.076695:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.076702:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.076723:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.076749:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.077366:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.077372:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.077382:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41000 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.077386:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.077404:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.077431:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.077439:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a650c8/0x24b6539075b3eeba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.077480:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.077482:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.077483:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941174.077770:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941174.077776:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.077784:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=782s v=(0 0) 00010000:00010000:3.0:1788941174.077787:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941174.077791:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.077815:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.077824:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.078381:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.078442:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788941174.081739:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.081756:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.081774:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.081779:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.081785:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.081801:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.081814:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.081821:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.090341:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941174.090362:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.090377:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40a00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.090383:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.090395:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.090417:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.090425:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064ac9e33/0x24b6539075b3eec1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.091582:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.091594:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.091606:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09b400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.091618:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.091629:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.091643:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.091652:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.091654:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.091657:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.091736:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788941174.091744:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad8c8797/0x24b6539075b3eec8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.092210:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941174.092699:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.092711:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.092724:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.092728:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.092734:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.092746:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.092755:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.092762:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.093248:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788941174.098384:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.098401:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.098419:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.098424:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.098431:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.098445:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.098463:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.098471:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.102951:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941174.102976:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.103214:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09a400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.103221:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.103233:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.103260:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.103268:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f72a57b/0x24b6539075b3eecf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.103949:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.104458:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.104471:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09ac00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.104475:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.104485:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.104501:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.104514:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.104516:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.104519:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.106039:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788941174.106053:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c6245df/0x24b6539075b3eed6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788941174.112558:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.112576:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.112597:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.112601:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.112608:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.112625:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.112637:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.112661:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.122738:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.122761:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.122778:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a29600 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.122784:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.122825:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.122862:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.124711:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.124719:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.124723:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.125540:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788941174.125552:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c983606/0x24b6539075b3eedd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.126214:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941174.126560:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.126570:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.126586:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.126592:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.126599:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.126615:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.126626:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.126634:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.126661:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.127299:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.127310:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.127321:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a28c00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.127326:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.127337:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.127354:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.127361:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0eb6bab/0x24b6539075b3eee4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.127394:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.127396:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.127398:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941174.129276:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.129292:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.129312:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.129318:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.129324:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.129339:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.129349:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.129357:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.129370:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.129808:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.129817:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.129827:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a28200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.129848:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.129859:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.129878:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.129885:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0f88f74/0x24b6539075b3eeeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.129907:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.129909:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.129911:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941174.132782:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.132797:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.132818:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.132866:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.132873:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.132890:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.132901:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.132908:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.132933:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.133221:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.133231:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.133252:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a28e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.133256:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.133266:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.133282:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.133290:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010816e3e/0x24b6539075b3eef2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.133311:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.133312:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.133314:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941174.136594:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.136610:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.136629:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.136633:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.136640:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.136654:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.136665:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.136687:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.136717:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.137098:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.137106:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.137116:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a28600 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.137121:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.137131:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.137155:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.137163:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049bcc16c/0x24b6539075b3eef9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.137183:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.137185:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.137187:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941174.145522:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.145540:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.145560:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.145565:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.145572:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.145586:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.145597:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.145606:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.145631:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788941174.148770:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941174.148786:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.148807:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=782s v=(0 0) 00010000:00010000:0.0:1788941174.148813:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941174.148818:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.148862:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.148874:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.148883:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.148903:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788941174.157197:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788941174.157214:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157228:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a29800 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941174.157234:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157245:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157268:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157276:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cf23d51/0x24b6539075b3ef00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157307:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941174.157311:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157343:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a29a00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941174.157346:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157354:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157363:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157370:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ec469d/0x24b6539075b3ef07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.157385:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941174.157387:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941174.157389:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941174.164252:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.164270:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.164291:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.164297:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.164304:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.164320:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.164346:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.164354:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.164388:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941174.164941:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.164948:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.164968:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.164971:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.164975:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.164993:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.165002:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.165008:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.165027:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788941174.165472:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.165478:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.165487:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.165490:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.165494:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.165503:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.165510:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.165517:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.165526:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788941174.166147:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788941174.166155:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166172:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941174.166176:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166186:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166206:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166214:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059887226/0x24b6539075b3ef0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166233:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941174.166237:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166244:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941174.166247:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166254:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166264:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166278:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088d53415/0x24b6539075b3ef15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166292:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941174.166295:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166303:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941174.166306:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166314:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166324:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166331:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075308cf1/0x24b6539075b3ef1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.166343:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.166345:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.166347:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941174.166495:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.166502:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.166512:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.166521:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.166527:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.166538:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.166546:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.166554:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.166581:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941174.167268:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941174.167276:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.167285:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4c00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941174.167289:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.167298:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.167324:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.167331:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e27f5d6c/0x24b6539075b3ef23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941174.167347:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.167350:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.167351:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941174.167411:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.167416:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.167425:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.167428:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.167432:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.167442:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.167451:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.167465:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.167486:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941174.167770:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941174.167776:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.167790:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941174.167794:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.167802:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.167813:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.167819:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf728c52/0x24b6539075b3ef2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.167854:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.167856:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.167858:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941174.167898:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941174.168148:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.168154:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.168163:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.168166:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.168170:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.168179:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.168187:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.168194:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.169127:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941174.173680:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.173694:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.173724:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.173730:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.173737:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.173753:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.173763:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.173771:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177247:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941174.177263:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177278:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941174.177283:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177296:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177332:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177340:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009378b4b9/0x24b6539075b3ef31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177366:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941174.177370:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177377:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5a00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:3.0:1788941174.177381:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177388:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177398:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941174.177407:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.177409:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941174.177411:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941174.185802:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788941174.185818:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b033db/0x24b6539075b3ef38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.186354:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941174.189811:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.189827:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.189870:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.189876:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.189883:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.189920:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.189932:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.189941:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.189978:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941174.191028:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.191037:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191048:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.191052:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.191067:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191079:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191087:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191105:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191123:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788941174.191460:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941174.191468:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191476:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.191481:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191489:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191505:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191512:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004edda355/0x24b6539075b3ef3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191540:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.191543:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191549:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5800 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.191552:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191558:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191567:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191574:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085fb26bc/0x24b6539075b3ef46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.191584:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.191586:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.191587:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941174.191668:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941174.191674:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191682:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=782s v=(0 0) 00010000:00010000:2.0:1788941174.191685:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941174.191689:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191699:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191706:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191712:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941174.191733:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941174.192041:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941174.192046:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.192054:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4600 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941174.192073:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.192081:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.192092:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.192097:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d51cecf/0x24b6539075b3ef4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941174.192111:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.192113:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941174.192115:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788941174.192202:0:24204:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788941174.192293:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22721:x1875840102303104:12345-0@lo:5:osp-pre-0-0.0 Request processed in 217733us (217875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941174.192308:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788941174.192362:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22721:1875840102303104:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788941174.192376:0:22721:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788941174.192422:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22721:1875840102303232:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788941174.192454:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941174.196148:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc4deb900 going to sleep for 11 seconds 00000100:00100000:2.0:1788941174.196179:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102303232 00000100:00100000:2.0:1788941174.196188:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102303232 00010000:00010000:3.0:1788941174.196329:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941174.199261:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941174.199287:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22721:x1875840102303232:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788941174.199342:0:24203:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1788941174.220215:0:24199:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788941174.220270:0:24199:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788941174.221270:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22721:x1875840102303232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 21987us (28806us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788941174.221298:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788941174.223014:0:22721:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788941174.223033:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22721:1875840102303232:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788941174.223053:0:22721:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1788941174.596149:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941175.173303:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102303360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941175.173388:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941175.173448:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102303360 00000100:00100000:2.0:1788941175.173457:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102303360 00000100:00100000:2.0:1788941175.173506:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788941175.173517:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cc01b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102303360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788941175.173555:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788941175.173604:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cc01b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102303360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941175.173611:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788941175.173661:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102303360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941175.176550:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941175.176572:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102303488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941175.176635:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941175.176686:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102303488 00000100:00100000:0.0:1788941175.176693:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102303488 00000100:00100000:0.0:1788941175.176743:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788941175.176752:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102303488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788941175.176773:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941175.176816:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102303488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941175.176823:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788941175.176882:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788941175.176931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102303488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788941175.181870:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788941175.181892:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102303616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788941175.181955:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941175.182016:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102303616 00000100:00100000:1.0:1788941175.182024:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102303616 00000100:00100000:1.0:1788941175.182086:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788941175.182095:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102303616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941175.182130:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941175.182176:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102303616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941175.182184:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788941175.182228:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102303616:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788941175.620221:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788941176.196976:0:23449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941176.645993:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941177.672622:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788941178.175738:0:25017:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788941178.175748:0:25017:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788941178.175750:0:25017:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788941178.175912:0:25017:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cac8895000 00000020:01000004:3.0:1788941178.175927:0:25017:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788941178.178654:0:25017:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788941178.178680:0:25017:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99cbfd80b380) 00000020:00000080:3.0:1788941178.178705:0:25017:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788941178.235061:0:25017:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788941178.236925:0:25017:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788941178.237159:0:25017:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788941178.237628:0:25017:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788941178.237954:0:25017:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788941178.238138:0:25017:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788941178.238306:0:25017:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1788941178.239443:0:25017:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788941178.239706:0:25017:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788941178.239720:0:25017:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788941178.239730:0:25017:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24b6539075b3ef5b 00000020:01000004:1.0:1788941178.239737:0:25017:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788941178.239758:0:25017:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788941178.239762:0:25017:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788941178.239768:0:25017:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788941178.239796:0:25017:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788941178.239800:0:25017:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788941178.256363:0:25017:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788941178.256441:0:25017:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.142@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788941178.256447:0:25017:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788941178.256449:0:25017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788941178.256450:0:25017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941178.256452:0:25017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941178.256453:0:25017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941178.256455:0:25017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941178.256456:0:25017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788941178.256458:0:25017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941178.256459:0:25017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788941178.256463:0:25017:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788941178.256465:0:25017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788941178.256466:0:25017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788941178.256467:0:25017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941178.256468:0:25017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941178.256470:0:25017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941178.256471:0:25017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941178.256472:0:25017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788941178.256473:0:25017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941178.256474:0:25017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788941178.256500:0:25017:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788941178.256580:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102303744:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788941178.256728:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.256962:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc51b9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788941178.257134:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102303744 00000100:00100000:1.0:1788941178.257142:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102303744 00000100:00100000:1.0:1788941178.257228:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788941178.257247:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:25017:x1875840102303744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788941178.257289:0:22688:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788941178.257292:0:22688:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788941178.257297:0:22688:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788941178.257604:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:25017:x1875840102303744:12345-0@lo:253:mount.lustre.0 Request processed in 358us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.257761:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102303744:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788941178.257773:0:25017:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788941178.257776:0:25017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788941178.257778:0:25017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788941178.257779:0:25017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941178.257781:0:25017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941178.257782:0:25017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941178.257783:0:25017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941178.257784:0:25017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788941178.257793:0:25017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941178.257795:0:25017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788941178.257814:0:25017:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cac8895000 from lustre-OST0001 10000000:01000000:2.0:1788941178.257871:0:25017:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788941178.257875:0:25017:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788941178.257891:0:25017:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cbf93a3380 local copy 00010000:00010000:2.0:1788941178.257903:0:25017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941178.258026:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102303872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941178.258063:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941178.258109:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788941178.258330:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cc009a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941178.258425:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102303872 00000100:00100000:1.0:1788941178.258431:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102303872 00000100:00100000:1.0:1788941178.258455:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788941178.258462:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:25017:x1875840102303872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941178.258575:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:25017:x1875840102303872:12345-0@lo:501:mount.lustre.0 Request processed in 114us (511us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788941178.258583:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788941178.258801:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102303872:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788941178.258815:0:25017:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788941178.258862:0:25017:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788941178.258868:0:25017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941178.258878:0:25017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f41e00/0x24b6539075b3eb8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3eb95 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941178.258974:0:25017:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cac8895000 10000000:01000000:2.0:1788941178.258980:0:25017:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788941178.258996:0:25017:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788941178.258999:0:25017:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788941178.259004:0:25017:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788941178.259006:0:25017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788941178.259032:0:25017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5200/0x24b6539075b3ef62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941178.259054:0:25017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5200/0x24b6539075b3ef62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941178.259065:0:25017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5200/0x24b6539075b3ef62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941178.259080:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788941178.259110:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.259127:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cc009a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941178.259233:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102304000 00000100:00100000:1.0:1788941178.259239:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102304000 00000100:00100000:1.0:1788941178.259306:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788941178.259314:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:25017:x1875840102304000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941178.259327:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941178.259340:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac19a4200/0x24b6539075b3ef69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ef62 expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.259363:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac19a4200/0x24b6539075b3ef69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ef62 expref: 22 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.259374:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac19a4200/0x24b6539075b3ef69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ef62 expref: 22 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.259394:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac19a4200, rc 0) 00000100:00100000:1.0:1788941178.259434:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304000:12345-0@lo:101:mount.lustre.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941178.259441:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788941178.259497:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941178.259509:0:25017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5200/0x24b6539075b3ef62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef69 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941178.259518:0:25017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5200/0x24b6539075b3ef62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ef69 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788941178.260747:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788941178.261402:0:25017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941178.266143:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788941178.266664:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788941178.266678:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788941178.266686:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788941178.266693:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788941178.266700:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788941178.266707:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788941178.266714:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788941178.266720:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788941178.266736:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788941178.266746:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788941178.267260:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941178.267332:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.267446:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cc009a46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941178.271926:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102304128 00000100:00100000:3.0:1788941178.271947:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102304128 00000100:00100000:3.0:1788941178.272043:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788941178.272054:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941178.272255:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304128:12345-0@lo:501:mount.lustre.0 Request processed in 203us (4921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941178.272263:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788941178.272284:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941178.272340:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788941178.272398:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.272468:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cc009a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.272500:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102304256 00000100:00100000:0.0:1788941178.272513:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102304256 00000100:00100000:0.0:1788941178.272580:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788941178.272588:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941178.274599:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304256:12345-0@lo:503:mount.lustre.0 Request processed in 2000us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.274614:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788941178.274718:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788941178.275284:0:25017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788941178.275368:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941178.275430:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.275898:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cc009a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941178.275982:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102304384 00000100:00100000:1.0:1788941178.276000:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102304384 00000100:00100000:1.0:1788941178.276039:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788941178.276049:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941178.276701:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304384:12345-0@lo:502:mount.lustre.0 Request processed in 651us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941178.276710:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788941178.277699:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941178.278218:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788941178.278252:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788941178.278271:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788941178.278285:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788941178.278300:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788941178.278313:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788941178.278326:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788941178.278339:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788941178.278352:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788941178.278392:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941178.278453:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.278495:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cc009a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941178.278742:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102304512 00000100:00100000:1.0:1788941178.278751:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102304512 00000100:00100000:1.0:1788941178.278805:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788941178.278815:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941178.278992:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304512:12345-0@lo:502:mount.lustre.0 Request processed in 169us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941178.279000:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788941178.279167:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941178.279223:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788941178.279232:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788941178.280316:0:25022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788941178.280326:0:25022:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788941178.280334:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.280336:0:25022:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788941178.280343:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788941178.280370:0:25022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99cac6653380) 00000020:00000080:2.0:1788941178.280397:0:25022:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788941178.280405:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788941178.280482:0:25022:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cac8895000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788941178.280490:0:25022:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788941178.280497:0:25022:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24b6539075b3ef77 00010000:00010000:2.0:1788941178.285459:0:25022:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788941178.286166:0:25022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1788941178.288095:0:25022:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788941178.289802:0:25022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788941178.289814:0:25022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941178.289821:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.289823:0:25022:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788941178.289826:0:25022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941178.289831:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.289950:0:25022:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788941178.289957:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788941178.289959:0:25022:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788941178.289961:0:25022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941178.289964:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.289965:0:25022:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788941178.289967:0:25022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941178.289970:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.289971:0:25022:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788941178.289981:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788941178.290021:0:25022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941178.290025:0:25022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.290026:0:25022:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788941178.290029:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788941178.291003:0:25017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788941178.291041:0:25017:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788941178.291068:0:25017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5200/0x24b6539075b3ef62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef69 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.291081:0:25017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5200/0x24b6539075b3ef62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef69 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941178.291089:0:25017:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cac8895000 from 1 10000000:01000000:3.0:1788941178.291092:0:25017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788941178.291133:0:25017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.291141:0:25017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.291152:0:25017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941178.291183:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941178.291254:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941178.291301:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac109e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.291373:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102304640 00000100:00100000:0.0:1788941178.291383:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102304640 00000100:00100000:0.0:1788941178.291432:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788941178.291441:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:25017:x1875840102304640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941178.291454:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941178.291467:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ef7e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.291492:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.291504:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.291512:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbd3a29800, rc 0) 00000100:00100000:0.0:1788941178.291551:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102304640:12345-0@lo:101:mount.lustre.0 Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.291557:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788941178.291641:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941178.291654:0:25017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.291664:0:25017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788941178.292675:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788941178.294056:0:25017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941178.294258:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788941178.294276:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788941178.294283:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788941178.294305:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788941178.294313:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788941178.294320:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788941178.294326:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788941178.294333:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788941178.294340:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788941178.294347:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788941178.294353:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788941178.294363:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788941178.294366:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788941178.294444:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941178.294498:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941178.294538:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc539e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788941178.294557:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102304768 00000100:00100000:1.0:1788941178.294564:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102304768 00000100:00100000:1.0:1788941178.294617:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788941178.294625:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102304768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941178.294733:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102304768:12345-0@lo:501:mount.lustre.0 Request processed in 109us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941178.294742:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788941178.295589:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941178.295633:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941178.295684:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941178.295716:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc539e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.296998:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102304896 00000100:00100000:0.0:1788941178.297009:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102304896 00000100:00100000:0.0:1788941178.297066:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788941178.297074:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102304896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941178.297271:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102304896:12345-0@lo:503:mount.lustre.0 Request processed in 196us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.297278:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788941178.297424:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102304896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788941178.300248:0:25017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788941178.300354:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941178.300452:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941178.300506:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbd5c38b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.300760:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102305024 00000100:00100000:0.0:1788941178.300770:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102305024 00000100:00100000:0.0:1788941178.300826:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788941178.300861:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102305024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941178.301018:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102305024:12345-0@lo:502:mount.lustre.0 Request processed in 183us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.301026:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788941178.301053:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941178.301289:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788941178.301318:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788941178.301333:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788941178.301347:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788941178.301361:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788941178.301374:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788941178.301386:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788941178.301398:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788941178.301427:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788941178.301442:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788941178.301455:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788941178.301476:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941178.301511:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941178.301548:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcbc32780 going to sleep for 11 seconds 00000100:00100000:1.0:1788941178.301749:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102305152 00000100:00100000:1.0:1788941178.301757:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102305152 00000100:00100000:1.0:1788941178.301795:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788941178.301804:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102305152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941178.301928:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102305152:12345-0@lo:502:mount.lustre.0 Request processed in 124us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941178.301935:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788941178.302075:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941178.302116:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788941178.302123:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788941178.305082:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941178.305096:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.305099:0:25026:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788941178.305107:0:25026:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cac8895000 00000020:00000080:2.0:1788941178.305109:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788941178.305118:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941178.305121:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.305122:0:25026:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788941178.305125:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941178.305127:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.305129:0:25026:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788941178.305132:0:25026:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cac8895000 00000020:00000080:2.0:1788941178.305134:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788941178.305230:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941178.305234:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.305235:0:25026:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788941178.305238:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941178.305240:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.305241:0:25026:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788941178.305245:0:25026:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cac8895000 00000020:00000080:2.0:1788941178.305247:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788941178.305264:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941178.305266:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.305267:0:25026:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788941178.305269:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941178.305272:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.305273:0:25026:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788941178.305293:0:25026:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cac8895000 00000020:00000080:2.0:1788941178.305295:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788941178.305320:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941178.305323:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941178.305325:0:25026:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788941178.305328:0:25026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788941178.305583:0:25017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788941178.305622:0:25017:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788941178.305651:0:25017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.305665:0:25017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941178.305722:0:25017:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788941178.305726:0:25017:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cac8895000 10000000:01000000:0.0:1788941178.305730:0:25017:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cac8895000 10000000:01000000:0.0:1788941178.305734:0:25017:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788941178.305740:0:25017:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cac8895000 from 1 10000000:01000000:0.0:1788941178.305743:0:25017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788941178.305795:0:25017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28600/0x24b6539075b3ef8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.305804:0:25017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28600/0x24b6539075b3ef8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.305816:0:25017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28600/0x24b6539075b3ef8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941178.305862:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941178.305954:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941178.306016:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102305280 00000100:00100000:0.0:1788941178.306024:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102305280 00000100:00100000:0.0:1788941178.306067:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788941178.306076:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:25017:x1875840102305280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941178.306091:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941178.306103:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbd3a28e00/0x24b6539075b3ef93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3ef8c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.306127:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbd3a28e00/0x24b6539075b3ef93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3ef8c expref: 24 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.306137:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbd3a28e00/0x24b6539075b3ef93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ef8c expref: 24 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.306145:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbd3a28e00, rc 0) 00000100:00100000:0.0:1788941178.306176:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305280:12345-0@lo:101:mount.lustre.0 Request processed in 100us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.306181:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788941178.306232:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfd94d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.306257:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941178.306272:0:25017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28600/0x24b6539075b3ef8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef93 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.306282:0:25017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28600/0x24b6539075b3ef8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3ef93 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788941178.307821:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788941178.312345:0:25017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788941178.312628:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788941178.312653:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788941178.312667:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788941178.312681:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788941178.312693:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788941178.312705:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788941178.312715:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788941178.312727:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788941178.312738:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788941178.312749:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788941178.312761:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788941178.312772:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788941178.312783:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788941178.312794:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788941178.312804:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788941178.312816:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788941178.312827:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788941178.312865:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788941178.312882:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788941178.312893:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788941178.312904:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788941178.312917:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788941178.312942:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788941178.312956:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788941178.312969:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788941178.312994:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788941178.313010:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788941178.313042:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788941178.313057:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788941178.313070:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788941178.313087:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788941178.313098:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788941178.313109:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788941178.313121:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788941178.313133:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788941178.313146:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788941178.313158:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788941178.313171:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788941178.313183:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788941178.313195:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788941178.313207:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788941178.313220:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788941178.313230:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788941178.313255:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788941178.313269:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788941178.313282:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788941178.313294:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788941178.313305:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788941178.313410:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788941178.313430:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788941178.313445:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788941178.313450:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788941178.313561:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941178.313636:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941178.313699:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102305408 00000100:00100000:0.0:1788941178.313706:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102305408 00000100:00100000:0.0:1788941178.313748:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788941178.313756:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941178.313880:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305408:12345-0@lo:501:mount.lustre.0 Request processed in 125us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.313888:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788941178.313930:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfd94d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.313950:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941178.313977:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941178.317792:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941178.317872:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102305536 00000100:00100000:0.0:1788941178.318057:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102305536 00000100:00100000:0.0:1788941178.318106:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788941178.318115:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941178.318231:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305536:12345-0@lo:503:mount.lustre.0 Request processed in 117us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.318239:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788941178.318286:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfd94d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.318308:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305536:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788941178.318755:0:25017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788941178.318855:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941178.319023:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941178.319052:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102305664 00000100:00100000:0.0:1788941178.319057:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102305664 00000100:00100000:0.0:1788941178.319079:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788941178.319093:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941178.319156:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305664:12345-0@lo:502:mount.lustre.0 Request processed in 63us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.319162:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788941178.319190:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfd94d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.319201:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941178.319343:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788941178.319364:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788941178.319375:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788941178.319386:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788941178.319397:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788941178.319418:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788941178.319429:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788941178.319440:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788941178.319450:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788941178.319461:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788941178.319472:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788941178.319482:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788941178.319625:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788941178.319642:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788941178.319653:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788941178.319663:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788941178.319674:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788941178.319684:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788941178.319694:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788941178.319704:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788941178.319714:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788941178.319734:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788941178.319745:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788941178.319756:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788941178.319774:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788941178.319784:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788941178.319798:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788941178.319809:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788941178.319819:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788941178.319829:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788941178.319867:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788941178.320619:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788941178.320659:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788941178.320676:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788941178.320690:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788941178.320700:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788941178.320713:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788941178.320739:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788941178.320752:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788941178.320764:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788941178.320776:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788941178.320787:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788941178.320799:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788941178.320813:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788941178.320826:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788941178.321445:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788941178.321468:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788941178.321482:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788941178.322227:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941178.322318:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941178.322364:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfd94d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788941178.322970:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102305792 00000100:00100000:1.0:1788941178.322991:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102305792 00000100:00100000:1.0:1788941178.323051:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788941178.323061:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941178.323271:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305792:12345-0@lo:502:mount.lustre.0 Request processed in 210us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941178.323279:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788941178.324154:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941178.324375:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788941178.324402:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788941178.324436:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941178.324488:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941178.324538:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfd94d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788941178.324640:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102305920 00000100:00100000:2.0:1788941178.324646:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102305920 00000100:00100000:2.0:1788941178.324688:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788941178.324697:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941178.324786:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102305920:12345-0@lo:502:mount.lustre.0 Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.324794:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788941178.326140:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102305920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941178.326230:0:25017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788941178.326243:0:25017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788941178.334912:0:25031:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788941178.334931:0:25031:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99cac6654d40) 00000020:00000080:2.0:1788941178.334956:0:25031:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788941178.335220:0:25031:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cac8895000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788941178.335225:0:25031:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cac8895000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788941178.335228:0:25031:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cac8895000 3 00010000:00080000:2.0:1788941178.335261:0:25031:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cac2db5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.142@tcp at head 00010000:00010000:2.0:1788941178.349773:0:25031:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788941178.350042:0:25031:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788941178.350094:0:25031:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788941178.350107:0:25031:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x24b6539075b3efa1 00000100:00080000:2.0:1788941178.350119:0:25031:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788941178.350131:0:25031:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cac2db5000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941178.350171:0:25031:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbfea7d180 x1875840102306048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941178.350208:0:25031:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788941178.350276:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875840102306048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788941178.350361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.354330:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102306048 00000100:00100000:2.0:1788941178.354352:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102306048 00000100:00100000:2.0:1788941178.354432:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788941178.354444:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875840102306048:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788941178.354486:0:22698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 787 last 0 00000020:00000080:2.0:1788941178.354534:0:22698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x24b6539075b3efa8 00000004:00100000:2.0:1788941178.354554:0:22698:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788941178.354597:0:22698:0:(import.c:65:import_set_state_nolock()) ffff99cac645f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941178.354707:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875840102306048:12345-0@lo:38:llog_process_th.0 Request processed in 264us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.354714:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788941178.354776:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbfea7d180 x1875840102306048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941178.354788:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941178.354796:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788941178.354805:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788941178.354809:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788941178.354812:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac2db5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788941178.354818:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875840102306048:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788941178.357212:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941178.357220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941178.357223:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941178.357231:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 782 00000100:00080000:2.0:1788941178.357236:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788941178.357250:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbfea41000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941178.357281:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe56e1180 x1875840102306560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941178.357314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941178.357317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941178.357319:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941178.357322:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 782 00000100:00080000:2.0:1788941178.357324:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788941178.357329:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99cbfda41800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941178.357339:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbe56e2680 x1875840102307072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941178.357384:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102306688:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.357552:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.357586:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102307328:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.357609:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.357633:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788941178.357638:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102306176:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.357681:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.357707:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102306816:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.357773:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.357791:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102307456:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.357811:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.357862:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102306304:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.357969:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.358132:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102306944:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.358163:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.358186:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788941178.358193:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102306432:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.358219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.358235:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102307200:0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.358273:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.358860:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102306688 00000100:00100000:2.0:1788941178.358870:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102306688 00000100:00100000:3.0:1788941178.359066:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102306944 00000100:00100000:3.0:1788941178.359071:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102306944 00000100:00100000:3.0:1788941178.359150:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102306432 00000100:00100000:3.0:1788941178.359154:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102306432 00000100:00100000:3.0:1788941178.359172:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941178.359181:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102306944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941178.359269:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102306944:12345-0@lo:400:kworker.0 Request processed in 89us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941178.359276:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941178.359294:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788941178.359300:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102306432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941178.359325:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102306432:12345-0@lo:400:kworker.0 Request processed in 26us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941178.359330:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788941178.360075:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102307328 00000100:00100000:2.0:1788941178.360082:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102307328 00000100:00100000:2.0:1788941178.360102:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102307456 00000100:00100000:2.0:1788941178.360105:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102307456 00000100:00100000:2.0:1788941178.360117:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102307200 00000100:00100000:2.0:1788941178.360120:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102307200 00000100:00100000:2.0:1788941178.360133:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788941178.360140:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102306688:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788941178.360158:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788941178.360163:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788941178.360165:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941178.360193:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875840102306688:12345-0@lo:400:kworker.0 Request processed in 54us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.360200:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788941178.360212:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788941178.360218:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875840102307328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.360245:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875840102307328:12345-0@lo:400:kworker.0 Request processed in 28us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.360251:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788941178.360261:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788941178.360267:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102307456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.360291:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102307456:12345-0@lo:400:kworker.0 Request processed in 25us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.360305:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788941178.360316:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788941178.360322:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102307200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.360350:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102307200:12345-0@lo:400:kworker.0 Request processed in 28us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.360355:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788941178.360374:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102306816 00000100:00100000:2.0:1788941178.360378:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102306816 00000100:00100000:2.0:1788941178.360410:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102306304 00000100:00100000:2.0:1788941178.360414:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102306304 00000100:00100000:2.0:1788941178.360427:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788941178.360433:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102306816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.360463:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102306816:12345-0@lo:400:kworker.0 Request processed in 30us (2690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.360469:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788941178.360479:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788941178.360484:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102306304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941178.360507:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102306304:12345-0@lo:400:kworker.0 Request processed in 23us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.360512:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788941178.360900:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102306176 00000100:00100000:0.0:1788941178.360906:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102306176 00000100:00100000:0.0:1788941178.360936:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788941178.360943:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3651:x1875840102306176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941178.360991:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3651:x1875840102306176:12345-0@lo:400:kworker.0 Request processed in 39us (3300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.360999:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788941178.362207:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102306176:0@lo:400:kworker.0 00000100:00100000:3.0:1788941178.362228:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102306816:0@lo:400:kworker.0 00010000:00080000:3.0:1788941178.362245:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e0380 x1875840102307456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941178.362257:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102307456:0@lo:400:kworker.0 00010000:00080000:3.0:1788941178.362268:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e0000 x1875840102306688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941178.362275:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875840102306688:0@lo:400:kworker.0 00010000:00080000:3.0:1788941178.362286:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e1880 x1875840102307328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941178.362292:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875840102307328:0@lo:400:kworker.0 00000100:00100000:0.0:1788941178.363049:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102306560:0@lo:8:kworker.0 00000100:00100000:0.0:1788941178.363111:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788941178.363124:0:25031:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:0.0:1788941178.363140:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102307072:0@lo:8:kworker.0 00000020:00000080:3.0:1788941178.363158:0:25031:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99cacb734d40) 00000100:00100000:0.0:1788941178.363159:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788941178.363323:0:25031:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788941178.363417:0:25031:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cac8895000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788941178.363421:0:25031:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cac8895000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788941178.363424:0:25031:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cac8895000 3 00010000:00080000:3.0:1788941178.363453:0:25031:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cac2dda000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.142@tcp at head 00000100:00100000:0.0:1788941178.365791:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102306560 00000100:00100000:0.0:1788941178.365808:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102306560 00000100:00100000:0.0:1788941178.365858:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102307072 00000100:00100000:0.0:1788941178.365861:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102307072 00000100:00100000:1.0:1788941178.365868:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788941178.366298:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102306432:0@lo:400:kworker.0 00010000:00080000:0.0:1788941178.366319:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cbe56e3b80 x1875840102307200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941178.366331:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102307200:0@lo:400:kworker.0 00000100:00100000:0.0:1788941178.366353:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102306304:0@lo:400:kworker.0 00000100:00100000:0.0:1788941178.366365:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102306944:0@lo:400:kworker.0 00000100:00100000:1.0:1788941178.367331:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875840102306560:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788941178.367441:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875840102306560:12345-0@lo:8:kworker.0 Request processed in 1563us (4327us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788941178.367450:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941178.367476:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941178.367481:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875840102307072:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788941178.367510:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875840102307072:12345-0@lo:8:kworker.0 Request processed in 28us (4350us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788941178.367515:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941178.367554:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941178.367562:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941178.367567:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788941178.367577:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102306560:0@lo:8:kworker.0 00000100:00100000:1.0:1788941178.367592:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941178.367595:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941178.367598:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788941178.367601:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102307072:0@lo:8:kworker.0 00010000:00010000:3.0:1788941178.382726:0:25031:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788941178.383969:0:25031:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788941178.384239:0:25031:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788941178.384257:0:25031:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x24b6539075b3efb6 00000100:00080000:3.0:1788941178.384270:0:25031:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941178.384287:0:25031:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99cac2dda000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788941178.384332:0:25031:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac7c65500 x1875840102307584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941178.384369:0:25031:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788941178.385223:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875840102307584:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788941178.385333:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.385573:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102307584 00000100:00100000:2.0:1788941178.385582:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102307584 00000100:00100000:2.0:1788941178.385632:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788941178.385640:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875840102307584:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788941178.385689:0:22697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 787 last 0 00000020:00000080:2.0:1788941178.385732:0:22697:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x24b6539075b3efbd 00000004:00100000:2.0:1788941178.385754:0:22697:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788941178.385801:0:22697:0:(import.c:65:import_set_state_nolock()) ffff99cac6459000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1788941178.385961:0:25031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:2.0:1788941178.389133:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875840102307584:12345-0@lo:38:llog_process_th.0 Request processed in 3481us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941178.389150:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788941178.389253:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cac7c65500 x1875840102307584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941178.389267:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941178.389278:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788941178.389289:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788941178.389294:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788941178.389298:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cac2dda000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788941178.389306:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875840102307584:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788941178.390397:0:25017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788941178.390444:0:25017:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788941178.390462:0:25017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28600/0x24b6539075b3ef8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef93 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.390475:0:25017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28600/0x24b6539075b3ef8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3ef93 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788941178.390530:0:25017:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788941178.390533:0:25017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788941178.390534:0:25017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941178.390535:0:25017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941178.390537:0:25017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941178.390538:0:25017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941178.390539:0:25017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941178.390541:0:25017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941178.390546:0:25017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788941178.390550:0:25017:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788941178.390552:0:25017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788941178.390553:0:25017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788941178.390554:0:25017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941178.390555:0:25017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941178.390556:0:25017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941178.390557:0:25017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941178.390558:0:25017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941178.390559:0:25017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941178.390560:0:25017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788941178.390585:0:25017:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788941178.390669:0:25017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102307712:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788941178.390731:0:25017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941178.390770:0:25017:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcbc32900 going to sleep for 11 seconds 00000100:00100000:0.0:1788941178.398469:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102307712 00000100:00100000:0.0:1788941178.398491:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102307712 00000100:00100000:0.0:1788941178.398564:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788941178.398577:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102307712:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788941178.398628:0:22691:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788941178.398646:0:22691:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788941178.418751:0:22691:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788941178.418775:0:22691:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788941178.419927:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:25017:x1875840102307712:12345-0@lo:253:mount.lustre.0 Request processed in 21345us (29188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.419942:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 20000000:01000000:3.0:1788941178.420334:0:22712:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788941178.420340:0:22712:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788941178.420363:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.420381:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 23 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.420389:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 23 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.420397:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.420440:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 23 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.420454:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 23 pid: 22689 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941178.420488:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c66680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102307840:0@lo:104: 00000100:00100000:3.0:1788941178.420526:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941178.420568:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 23 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941178.420577:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 23 pid: 22688 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941178.420586:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7c65880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102307968:0@lo:104: 00000100:00100000:3.0:1788941178.420605:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941178.420630:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbcbc32780 going to sleep for 11 seconds 00000100:00100000:2.0:1788941178.420745:0:25017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:25017:1875840102307712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788941178.420759:0:25017:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788941178.420763:0:25017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788941178.420764:0:25017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788941178.420766:0:25017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941178.420767:0:25017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941178.420769:0:25017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941178.420770:0:25017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941178.420771:0:25017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788941178.420773:0:25017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941178.420775:0:25017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788941178.420791:0:25017:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788941178.421712:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102307840 00000100:00100000:0.0:1788941178.421720:0:22679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102307840 00000100:00100000:0.0:1788941178.421751:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102307968 00000100:00100000:0.0:1788941178.421754:0:22679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102307968 00000100:00100000:0.0:1788941178.421768:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941178.421776:0:22679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:22712:x1875840102307840:12345-0@lo:104: 00010000:00010000:0.0:1788941178.421791:0:22679:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.421896:0:22679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788941178.421903:0:22679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:22712:x1875840102307840:12345-0@lo:104: Request processed in 128us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.421910:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941178.421924:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788941178.421937:0:22679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:22712:x1875840102307968:12345-0@lo:104: 00010000:00010000:0.0:1788941178.421945:0:22679:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.421978:0:22679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788941178.422150:0:22679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:22712:x1875840102307968:12345-0@lo:104: Request processed in 212us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941178.422157:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788941178.422245:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788941178.422252:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422260:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5600 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:0.0:1788941178.422265:0:22685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422273:0:22685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788941178.422280:0:22685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941178.422286:0:22685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788941178.422322:0:22685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422329:0:22685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788941178.422349:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422366:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac19a5600/0x24b6539075b3ee58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee5f expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422376:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941178.422380:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422385:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40200 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:0.0:1788941178.422389:0:22685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422395:0:22685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788941178.422401:0:22685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941178.422406:0:22685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788941178.422419:0:22685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422425:0:22685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788941178.422432:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422438:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7f40200/0x24b6539075b3ee4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee51 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941178.422450:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941178.422457:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941178.422459:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941178.422480:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102308096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788941178.422512:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941178.422544:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941178.422550:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102308224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788941178.422569:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941178.422945:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c66680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102307840:0@lo:104: 00000100:00100000:2.0:1788941178.422965:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7c65880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22712:1875840102307968:0@lo:104: 00010000:00010000:2.0:1788941178.423129:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788941178.424273:0:25017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:0.0:1788941178.424970:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941178.425144:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102308096 00000100:00100000:1.0:1788941178.425154:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102308096 00010000:00010000:1.0:1788941178.425196:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 24 pid: 22689 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941178.425227:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102308224 00000100:00100000:1.0:1788941178.425231:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102308224 00010000:00010000:1.0:1788941178.425243:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 25 pid: 22688 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941178.425265:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788941178.425272:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+25:3649:x1875840102308096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941178.425286:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941178.425292:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 25 pid: 22689 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425304:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 25 pid: 22689 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425420:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfc09ae00/0x24b6539075b3ee5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ee58 expref: 25 pid: 22689 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425437:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941178.425517:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3649:x1875840102308096:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941178.425525:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788941178.425541:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788941178.425547:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:3649:x1875840102308224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941178.425554:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941178.425558:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 23 pid: 22688 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425567:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 23 pid: 22688 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425578:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac19a5400/0x24b6539075b3ee51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ee4a expref: 23 pid: 22688 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425590:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425720:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788941178.425738:0:22683:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005398407s 00010000:00010000:1.0:1788941178.425749:0:22683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425757:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425765:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425782:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425789:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40a00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941178.425793:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425802:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425818:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425830:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941178.425879:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:3649:x1875840102308224:12345-0@lo:103:ldlm_bl.0 Request processed in 332us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941178.425886:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788941178.425914:0:22712:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425922:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941178.425929:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f40a00/0x24b6539075b3efc4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941178.425996:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102308224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941178.426007:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102308096:0@lo:103:ldlm_bl.0 00002000:00080000:2.0:1788941178.439560:0:25017:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788941178.439570:0:25017:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788941178.439611:0:25017:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788941178.439661:0:25017:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788941178.439681:0:25017:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788941178.439716:0:25017:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788941178.440633:0:25017:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941178.440910:0:25017:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788941178.692424:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941179.268369:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788941179.268400:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102308352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788941179.268653:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941179.268702:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102308352 00000100:00100000:1.0:1788941179.268714:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102308352 00000100:00100000:0.0:1788941179.269132:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788941179.269143:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102308352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788941179.269176:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941179.269227:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102308352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941179.269235:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788941179.269284:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102308352:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1788941179.568815:0:25086:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788941179.569083:0:25086:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788941179.726151:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788941180.164084:0:22693:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788941180.164092:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cac84eb800 from 14 10000000:01000000:0.0:1788941180.164097:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788941180.164147:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29200/0x24b6539075b3efcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941180.164159:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29200/0x24b6539075b3efcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941180.164171:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29200/0x24b6539075b3efcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941180.164216:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102308480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788941180.164288:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941180.164392:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf6bb2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788941180.164451:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102308480 00000100:00100000:3.0:1788941180.164460:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102308480 00000100:00100000:3.0:1788941180.164520:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788941180.164529:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:22693:x1875840102308480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941180.164608:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941180.164623:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7f41c00/0x24b6539075b3efd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3efcb expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941180.164650:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f41c00/0x24b6539075b3efd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3efcb expref: 23 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941180.164662:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7f41c00/0x24b6539075b3efd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3efcb expref: 23 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941180.164744:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f41c00, rc 0) 00000100:00100000:3.0:1788941180.164871:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102308480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941180.164879:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788941180.165023:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102308480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941180.165038:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29200/0x24b6539075b3efcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3efd2 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941180.165048:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29200/0x24b6539075b3efcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3efd2 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941180.165097:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102308608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788941180.165128:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941180.165161:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf6bb2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788941180.165179:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102308608 00000100:00100000:2.0:1788941180.165184:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102308608 00000100:00100000:2.0:1788941180.165213:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788941180.165218:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102308608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788941180.165228:0:22691:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788941180.165241:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788941180.165243:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788941180.165321:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102308608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941180.165329:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788941180.165333:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102308608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788941180.165393:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788941180.165399:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29200/0x24b6539075b3efcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3efd2 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941180.165407:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbd3a29200/0x24b6539075b3efcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3efd2 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941180.165416:0:22693:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788941180.165418:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cbe5775000 from 14 10000000:01000000:0.0:1788941180.165420:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788941180.165435:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28400/0x24b6539075b3efd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941180.165452:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28400/0x24b6539075b3efd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941180.165461:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28400/0x24b6539075b3efd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941180.165473:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102308736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788941180.165495:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941180.165559:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf6bb2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788941180.165642:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102308736 00000100:00100000:3.0:1788941180.165646:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102308736 00000100:00100000:3.0:1788941180.165674:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788941180.165738:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102308736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941180.165745:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941180.165753:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7f41200/0x24b6539075b3efe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3efd9 expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941180.165766:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f41200/0x24b6539075b3efe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3efd9 expref: 24 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941180.165774:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7f41200/0x24b6539075b3efe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3efd9 expref: 24 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941180.165780:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f41200, rc 0) 00000100:00100000:3.0:1788941180.165926:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:22693:x1875840102308736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941180.165933:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788941180.166013:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102308736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941180.166024:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28400/0x24b6539075b3efd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3efe0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941180.166032:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28400/0x24b6539075b3efd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3efe0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941180.166070:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102308864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788941180.166098:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941180.166126:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf6bb2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788941180.166155:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102308864 00000100:00100000:1.0:1788941180.166159:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102308864 00000100:00100000:1.0:1788941180.166185:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788941180.166190:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:22693:x1875840102308864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788941180.166198:0:22689:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788941180.166207:0:22689:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788941180.166209:0:22689:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788941180.166278:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:22693:x1875840102308864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941180.166285:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788941180.166289:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102308864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788941180.166329:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788941180.166335:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28400/0x24b6539075b3efd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3efe0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941180.166342:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cbd3a28400/0x24b6539075b3efd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3efe0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941180.292000:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102308992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788941180.292075:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941180.293738:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788941180.293757:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102309120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941180.293813:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941180.293870:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102309120 00000100:00100000:2.0:1788941180.293878:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102309120 00000100:00100000:2.0:1788941180.293923:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788941180.293931:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102309120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788941180.293995:0:22702:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788941180.294057:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102309120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941180.294066:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788941180.294110:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102309120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941180.294204:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102308992 00000100:00100000:0.0:1788941180.294209:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102308992 00000100:00100000:0.0:1788941180.294250:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788941180.294256:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102308992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788941180.294271:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788941180.295000:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941180.295011:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102309248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788941180.295048:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941180.295757:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102308992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1499us (3680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941180.295766:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788941180.295794:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102309248 00000100:00100000:0.0:1788941180.295800:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102309248 00000100:00100000:0.0:1788941180.295849:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788941180.295858:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102309248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788941180.295888:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941180.295928:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102309248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941180.295934:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788941180.295963:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788941180.297603:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102308992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788941180.299325:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102309248:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788941180.740092:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788941181.001136:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788941181.764159:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941182.788288:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788941183.709795:0:25375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788941183.814102:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788941183.877047:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941183.877056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941183.877060:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941183.877076:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbfea41000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941183.877100:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac868bb80 x1875840102309760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941183.877134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941183.877137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941183.877138:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941183.877156:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99cbfda41800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788941183.877170:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cac8688e00 x1875840102310272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941183.877234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102309632:0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.877313:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941183.877352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102310400:0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.877376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941183.877411:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102310912:0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.877432:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941183.877467:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788941183.877473:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102309888:0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.877494:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941183.877510:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875840102310528:0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.877528:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941183.877548:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102309760:0@lo:8:kworker.0 00000100:00100000:2.0:1788941183.877567:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941183.877584:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102310272:0@lo:8:kworker.0 00000100:00100000:2.0:1788941183.877603:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941183.877634:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102309632 00000100:00100000:2.0:1788941183.877641:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102309632 00000100:00100000:2.0:1788941183.877692:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102309760 00000100:00100000:2.0:1788941183.877695:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102309760 00000100:00100000:2.0:1788941183.877705:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102310272 00000100:00100000:2.0:1788941183.877708:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102310272 00000100:00100000:2.0:1788941183.877719:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788941183.877729:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102309632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.877790:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102309632:12345-0@lo:400:kworker.0 Request processed in 61us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941183.877798:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788941183.877817:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788941183.877821:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875840102309760:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788941183.877878:0:24204:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 792 last 0 00000020:00000080:2.0:1788941183.877919:0:24204:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b6539075b3efe7 00002000:00100000:2.0:1788941183.877937:0:24204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cac6451000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788941183.877941:0:24204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788941183.877951:0:24204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788941183.878154:0:24204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788941183.878183:0:24204:0:(import.c:65:import_set_state_nolock()) ffff99cac6450800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941183.878222:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875840102309760:12345-0@lo:8:kworker.0 Request processed in 400us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941183.878229:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788941183.878242:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941183.878246:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875840102310272:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788941183.878261:0:24204:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 792 last 0 00000020:00000080:2.0:1788941183.878276:0:24204:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b6539075b3efee 00002000:00100000:2.0:1788941183.878281:0:24204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99cac6452000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788941183.878285:0:24204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788941183.878287:0:24204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788941183.878309:0:24204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788941183.878322:0:24204:0:(import.c:65:import_set_state_nolock()) ffff99cac6457000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941183.878351:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875840102310272:12345-0@lo:8:kworker.0 Request processed in 103us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941183.878358:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941183.878379:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102310400 00000100:00100000:2.0:1788941183.878383:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102310400 00000100:00100000:2.0:1788941183.878402:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102310912 00000100:00100000:2.0:1788941183.878405:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102310912 00000100:00100000:2.0:1788941183.878418:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102309888 00000100:00100000:2.0:1788941183.878421:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102309888 00000100:00100000:2.0:1788941183.878430:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102310528 00000100:00100000:2.0:1788941183.878432:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102310528 00000100:00100000:2.0:1788941183.878445:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788941183.878451:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102310400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.878492:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875840102310400:12345-0@lo:400:kworker.0 Request processed in 41us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941183.878498:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788941183.878511:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788941183.878517:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875840102310912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.878541:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875840102310912:12345-0@lo:400:kworker.0 Request processed in 25us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941183.878547:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788941183.878557:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788941183.878563:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102309888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.878589:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102309888:12345-0@lo:400:kworker.0 Request processed in 27us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941183.878596:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788941183.878607:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788941183.878613:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875840102310528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.878639:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875840102310528:12345-0@lo:400:kworker.0 Request processed in 27us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941183.878645:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788941183.878676:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941183.878680:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941183.878682:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788941183.878709:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac868bb80 x1875840102309760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788941208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941183.878723:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788941183.878730:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788941183.878735:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788941183.878743:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfea41000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788941183.878760:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788941183.878767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875840102309760:0@lo:8:kworker.0 00010000:00080000:2.0:1788941183.878783:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac8688e00 x1875840102310272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788941208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941183.878793:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788941183.878798:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788941183.878801:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788941183.878803:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbfda41800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788941183.878812:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788941183.878815:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875840102310272:0@lo:8:kworker.0 00010000:00080000:2.0:1788941183.878871:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac868aa00 x1875840102309888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941183.878879:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102309888:0@lo:400:kworker.0 00010000:00080000:2.0:1788941183.878905:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe7741f80 x1875840102310528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941183.878914:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875840102310528:0@lo:400:kworker.0 00000100:00100000:2.0:1788941183.878927:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102309632:0@lo:400:kworker.0 00010000:00080000:2.0:1788941183.878938:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe7740a80 x1875840102310400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941183.878946:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875840102310400:0@lo:400:kworker.0 00010000:00080000:2.0:1788941183.878957:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe7742d80 x1875840102310912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941183.878976:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875840102310912:0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.879364:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102309504:0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.879425:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.879475:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102310144:0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.879500:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.879520:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875840102310784:0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.879547:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.879568:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788941183.879576:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102309376:0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.879616:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.879642:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102310016:0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.879665:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.879680:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875840102310656:0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.879701:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788941183.879774:0:22723:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788941183.879793:0:22723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a33800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22723:1875840102311168:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788941183.879816:0:22723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.879983:0:22723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc49e96c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788941183.880017:0:23441:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788941183.880035:0:23441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23441:1875840102311424:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788941183.880061:0:23441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.880076:0:23441:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc49e9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788941183.880097:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102309376 00000100:00100000:1.0:1788941183.880103:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102309376 00000100:00100000:1.0:1788941183.880163:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788941183.880173:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3652:x1875840102309376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.880215:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3652:x1875840102309376:12345-0@lo:400:kworker.0 Request processed in 44us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941183.880222:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788941183.880257:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102311040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788941183.880286:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.880327:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102310784 00000100:00100000:1.0:1788941183.880331:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102310784 00000100:00100000:1.0:1788941183.880361:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102310656 00000100:00100000:1.0:1788941183.880369:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102310656 00000100:00100000:1.0:1788941183.880391:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788941183.880397:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875840102310784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.880429:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875840102310784:12345-0@lo:400:kworker.0 Request processed in 32us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941183.880436:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788941183.880446:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788941183.880453:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875840102310656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.880479:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875840102310656:12345-0@lo:400:kworker.0 Request processed in 27us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941183.880485:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788941183.880513:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102309376:0@lo:400:kworker.0 00010000:00080000:1.0:1788941183.880525:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe7742680 x1875840102310656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941183.880535:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875840102310656:0@lo:400:kworker.0 00010000:00080000:1.0:1788941183.880545:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe7741180 x1875840102310784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941183.880553:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875840102310784:0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.880565:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788941183.880573:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102311296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788941183.880594:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.880620:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102310144 00000100:00100000:1.0:1788941183.880624:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102310144 00000100:00100000:1.0:1788941183.880646:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102311168 00000100:00100000:1.0:1788941183.880649:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102311168 00000100:00100000:1.0:1788941183.880671:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102311424 00000100:00100000:1.0:1788941183.880675:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102311424 00000100:00100000:1.0:1788941183.880689:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788941183.880696:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102310144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941183.880733:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102310144:12345-0@lo:400:kworker.0 Request processed in 38us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941183.880739:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788941183.880750:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788941183.880757:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22723:x1875840102311168:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788941183.881059:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102310144:0@lo:400:kworker.0 00000004:00080000:3.0:1788941183.881637:0:22722:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788941183.881730:0:22722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792548894552ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788941183.881737:0:22722:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788941183.882449:0:23440:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788941183.882509:0:23440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 792549674442ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788941183.882516:0:23440:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788941183.882554:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102309504 00000100:00100000:0.0:1788941183.882561:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102309504 00000100:00100000:0.0:1788941183.882615:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102310016 00000100:00100000:0.0:1788941183.882620:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102310016 00000100:00100000:0.0:1788941183.882637:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788941183.882644:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102309504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941183.882725:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102309504:12345-0@lo:400:kworker.0 Request processed in 81us (3300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941183.882732:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788941183.882749:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788941183.882755:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102310016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941183.882796:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102310016:12345-0@lo:400:kworker.0 Request processed in 31us (3120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941183.882803:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788941183.882823:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102311040 00000100:00100000:0.0:1788941183.882827:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102311040 00000100:00100000:0.0:1788941183.882866:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102311296 00000100:00100000:0.0:1788941183.882870:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102311296 00000100:00100000:0.0:1788941183.882881:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941183.882898:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875840102311040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788941183.882920:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788941183.882961:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875840102311040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941183.882967:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941183.882978:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788941183.882984:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3652:x1875840102311296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788941183.882993:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788941183.883016:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3652:x1875840102311296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941183.883032:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788941183.883073:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9a32680 x1875840102311040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788941199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941183.883092:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102311040:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788941183.883126:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9a30000 x1875840102311296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788941199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941183.883138:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102311296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788941183.883149:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102310016:0@lo:400:kworker.0 00000100:00100000:0.0:1788941183.883160:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102309504:0@lo:400:kworker.0 00000100:00080000:2.0:1788941183.883955:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788941183.883965:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788941183.883970:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941183.883973:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788941183.894662:0:22676:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788941183.896730:0:24204:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788941183.896741:0:24204:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788941183.896747:0:24204:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:0.0:1788941183.898702:0:23429:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1788941183.907139:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.907153:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.907176:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.907182:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.907189:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.907209:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.907221:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.907241:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.907266:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941183.908216:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941183.908226:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.908237:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5000 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941183.908242:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.908252:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.908287:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.908312:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3eff5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.908337:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.908339:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.908341:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788941183.908621:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.908629:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.908639:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.908642:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.908647:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.908657:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.908665:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.908673:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.908728:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788941183.910232:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.910242:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.910267:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.910271:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.910278:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.910291:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.910301:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.910309:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.913577:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788941183.913592:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.913607:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4000 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941183.913613:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.913623:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.913649:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.913656:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3effc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.915013:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941183.915024:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.915042:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941183.915047:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.915055:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.915070:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.915080:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.915081:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.915083:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.915145:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788941183.915153:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f003 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788941183.915653:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.915660:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.915674:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.915679:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.915686:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.915712:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.915721:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.915728:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.915803:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788941183.916502:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.916508:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.916518:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.916522:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.916526:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.916537:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.916545:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.916563:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.918623:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788941183.918637:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.918649:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4a00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941183.918655:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.918666:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.918691:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.918698:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f00a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.918949:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941183.918956:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.918977:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4800 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941183.918981:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.918989:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.919000:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.919009:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.919011:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.919013:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.919913:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788941183.919923:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f011 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.920404:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788941183.920529:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.920536:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.920549:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.920553:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.920559:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.920575:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.920585:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.920593:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.920633:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941183.921921:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941183.921934:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.921947:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5600 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941183.921951:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.921962:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.921983:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.921999:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f018 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.922026:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.922028:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.922030:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788941183.923038:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.923048:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923062:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.923067:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.923074:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923088:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923098:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923105:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923129:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941183.923539:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941183.923546:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.923555:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941183.923560:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.923569:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.923584:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.923591:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f01f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.923611:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.923613:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.923614:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788941183.923700:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.923706:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923715:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.923725:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.923730:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923740:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923748:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.923756:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.927993:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788941183.928962:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.928973:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.928990:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.928995:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.929003:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.929019:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.929029:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.929045:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929614:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788941183.929624:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929634:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4c00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941183.929639:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929649:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929670:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929678:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f026 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929697:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941183.929701:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929707:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5800 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941183.929710:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929716:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929738:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.929746:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.929748:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941183.929750:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.936077:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.940083:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788941183.940101:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f02d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.940463:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788941183.940923:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.940932:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.940947:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.940952:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.940959:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.940975:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.940985:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.940993:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941027:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941183.941137:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.941144:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941154:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4a00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.941159:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941168:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941187:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941195:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f034 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941213:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.941216:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.941217:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788941183.941377:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.941383:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941392:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.941400:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.941405:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941413:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941421:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941428:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.941478:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788941183.948171:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.948186:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.948204:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.948209:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.948215:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.948231:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.948242:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.948257:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948332:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788941183.948340:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948348:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80cc00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941183.948352:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948363:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948392:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948399:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054f707ca/0x24b6539075b3f03b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948418:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941183.948421:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948428:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80d800 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941183.948431:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948438:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948447:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.948455:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.948457:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.948459:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.948544:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788941183.948549:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f042 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788941183.952116:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.952131:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.952148:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.952153:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.952160:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.952177:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.952189:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.952196:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.955950:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941183.955965:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.955992:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80d400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941183.955998:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.956010:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.956034:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.956066:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.956067:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.956069:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.956186:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788941183.956193:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014da7373/0x24b6539075b3f049 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788941183.960174:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.960192:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.960223:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.960228:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.960234:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.960249:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.960262:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.960270:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.960494:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941183.960502:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.960511:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80c200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941183.960515:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.960525:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.960542:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.960556:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.960558:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941183.960560:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.965855:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788941183.965874:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f050 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.966651:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788941183.968909:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.968924:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.968943:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.968948:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.968955:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.968972:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.968984:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.968993:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.969020:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941183.969038:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.969045:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.969054:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80d800 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.969059:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.969077:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.969096:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.969104:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0474d5f/0x24b6539075b3f057 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.969121:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.969123:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.969125:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941183.973516:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.973528:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.973547:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.973551:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.973559:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.973575:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.973585:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.973593:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.973614:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788941183.973960:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.973972:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.973981:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.973984:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.973988:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.973998:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.974007:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.974015:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.974028:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788941183.974298:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.974304:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.974313:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.974316:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.974320:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.974330:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.974344:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.974352:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.974360:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788941183.975063:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.975071:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975080:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.975083:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.975087:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975096:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975103:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975110:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975129:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788941183.975219:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788941183.975227:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975236:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a29e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.975241:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975250:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975267:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975288:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084fb3664/0x24b6539075b3f05e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975305:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788941183.975309:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975316:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a29400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.975319:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975327:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975338:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975345:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000510fbbcc/0x24b6539075b3f065 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975356:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941183.975360:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975366:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a29600 already unused, calling callback (ffffffffc0c8e8b0) 00002000:00010000:0.0:1788941183.975366:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.975371:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975374:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975379:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.975382:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975382:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.975386:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975392:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975395:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975400:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c983606/0x24b6539075b3f06c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975403:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975410:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975411:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.975414:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.975419:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941183.975420:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a28200 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.975423:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975430:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975440:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975446:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0f88f74/0x24b6539075b3f073 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975464:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.975467:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.975474:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a28c00 already unused, calling callback (ffffffffc0c8e8b0) 00002000:00010000:0.0:1788941183.976055:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.976062:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.976071:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.976080:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.976084:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.976094:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.976101:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.976108:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.976118:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788941183.979288:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.979303:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979320:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.979325:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.979330:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979345:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979356:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979371:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979382:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788941183.979676:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979689:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979710:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979718:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0eb6bab/0x24b6539075b3f07a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979744:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941183.979750:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979757:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbd3a29c00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.979761:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979780:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788941183.979789:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.979792:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979794:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979800:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d546285/0x24b6539075b3f081 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979803:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.979806:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.979810:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979813:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.979817:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979819:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979824:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4a00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.979827:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979828:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979851:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979851:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.979860:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941183.979862:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979869:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734cbd09/0x24b6539075b3f088 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979903:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.979906:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979913:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4c00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.979916:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979931:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979943:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979950:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e916421/0x24b6539075b3f08f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.979963:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.979965:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.979968:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941183.980145:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.980151:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980165:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.980168:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.980172:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980181:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980189:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980195:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980212:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788941183.980623:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.980630:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980640:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.980644:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.980648:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980657:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980676:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980683:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.980691:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788941183.982010:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788941183.982019:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982029:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941183.982033:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982043:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982060:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982067:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087e42e20/0x24b6539075b3f096 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982084:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941183.982088:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982096:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5600 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941183.982106:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982114:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982124:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941183.982131:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fd14fd5/0x24b6539075b3f09d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788941183.984049:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.984066:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984084:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.984089:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.984095:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984110:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984120:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984128:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984151:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941183.984182:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.984189:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.984197:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5800 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.984633:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.984643:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.984658:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.984665:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9e8c19/0x24b6539075b3f0a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.984682:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.984685:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.984686:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941183.984930:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.984936:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984946:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.984950:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.984954:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984964:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984972:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984979:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.984997:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941183.985568:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.985574:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.985583:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4800 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.985587:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.985596:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.985608:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.985622:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0f3a359/0x24b6539075b3f0ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.985637:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.985639:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.985640:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941183.985931:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.985937:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.985945:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.985953:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.985958:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.985968:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.985977:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.985984:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986003:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788941183.986290:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.986296:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986304:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.986307:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.986312:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986320:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986328:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986343:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986351:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788941183.986568:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941183.986574:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986582:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.986586:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986594:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986606:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986613:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce26bcf/0x24b6539075b3f0b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986628:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788941183.986628:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941183.986632:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986633:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986641:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=792s v=(0 0) 00010000:00010000:1.0:1788941183.986643:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a4000 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941183.986643:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941183.986647:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986648:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986656:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986657:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986665:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986666:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986674:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986675:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016daacd9/0x24b6539075b3f0b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.986682:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941183.986687:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.986690:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986696:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac19a5000 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:1.0:1788941183.986699:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986707:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986716:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986729:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005464cb36/0x24b6539075b3f0c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.986744:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.986746:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.986748:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941183.987962:0:24204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941183.987971:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.987988:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=792s v=(0 0) 00010000:00010000:0.0:1788941183.987992:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941183.987997:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.988008:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.988017:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.988023:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941183.988038:0:24204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788941183.988096:0:24204:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1788941183.988203:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22723:x1875840102311168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 107442us (108381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941183.988213:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788941183.988248:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941183.988262:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23441:x1875840102311424:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788941183.988359:0:22723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a33800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22723:1875840102311168:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788941183.988375:0:22723:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788941183.988433:0:22723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7e38000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22723:1875840102311552:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788941183.989340:0:22723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.989375:0:22723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfecd33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941183.989408:0:24205:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788941183.989415:0:24205:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1788941183.990536:0:24204:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788941183.990543:0:24204:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788941183.990624:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23441:x1875840102311424:12345-0@lo:7:osp-pre-1-1.0 Request processed in 2365us (110559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941183.990643:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941183.990672:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102311552 00000100:00100000:0.0:1788941183.990680:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102311552 00000100:00100000:0.0:1788941183.990717:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788941183.990724:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22723:x1875840102311552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788941183.990763:0:24204:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788941183.991628:0:23441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23441:1875840102311424:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788941183.991644:0:23441:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788941183.991681:0:23441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7e3b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23441:1875840102311680:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788941183.991720:0:23441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941183.991739:0:23441:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfecd3840 going to sleep for 11 seconds 00000001:00080000:3.0:1788941183.998997:0:25018:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00010000:00010000:1.0:1788941183.999028:0:22685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941183.999038:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.999053:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09ae00 already unused, calling callback (ffffffffc0c8e8b0) 00000001:00100000:3.0:1788941183.999056:0:25018:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1788941183.999058:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788941183.999061:0:25018:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788941183.999081:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.999115:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.999123:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e040a925/0x24b6539075b3f0c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941183.999155:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.999157:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941183.999159:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941183.999392:0:24203:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788941183.999405:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102311680 00000100:00100000:2.0:1788941183.999413:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102311680 00010000:00010000:3.0:1788941183.999894:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941183.999897:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941183.999898:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941184.001624:0:25391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788941184.001645:0:25391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23441:x1875840102311680:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788941184.001688:0:25391:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788941184.001799:0:25391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23441:x1875840102311680:12345-0@lo:5:osp-pre-1-1.0 Request processed in 161us (10078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941184.001808:0:25391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788941184.001875:0:23441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7e3b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23441:1875840102311680:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788941184.001901:0:23441:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788941184.001958:0:23441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7e3b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23441:1875840102311808:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788941184.001994:0:23441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941184.002025:0:23441:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbfecd3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788941184.002039:0:25391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102311808 00000100:00100000:1.0:1788941184.002051:0:25391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102311808 00000100:00100000:1.0:1788941184.002085:0:25391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788941184.002092:0:25391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23441:x1875840102311808:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788941184.002119:0:25391:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:0.0:1788941184.005555:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22723:x1875840102311552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14822us (16207us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788941184.005568:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788941184.006364:0:22723:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788941184.006376:0:22723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7e38000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22723:1875840102311552:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788941184.006406:0:22723:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:1.0:1788941184.038470:0:25391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23441:x1875840102311808:12345-0@lo:5:osp-pre-1-1.0 Request processed in 36369us (36468us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788941184.038541:0:25391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788941184.038673:0:23441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7e3b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23441:1875840102311808:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788941184.038690:0:23441:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1788941184.038727:0:23441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7742d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23441:1875840102311936:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788941184.038806:0:23441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941184.038827:0:23441:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc90a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788941184.038920:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102311936 00000100:00100000:1.0:1788941184.038928:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102311936 00000100:00100000:1.0:1788941184.038977:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941184.038987:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23441:x1875840102311936:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788941184.039037:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23441:x1875840102311936:12345-0@lo:900:osp-pre-1-1.0 Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941184.039042:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788941184.039089:0:23441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbe7742d80 x1875840102311936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788941200 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941184.039097:0:23441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7742d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23441:1875840102311936:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788941184.388359:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788941184.388391:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102312064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788941184.388584:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941184.388764:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102312064 00000100:00100000:0.0:1788941184.388774:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102312064 00000100:00100000:2.0:1788941184.388867:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788941184.388893:0:24206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102312064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788941184.388945:0:24206:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941184.389006:0:24206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102312064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941184.389013:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788941184.389036:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102312064:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1788941184.688215:0:25428:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788941184.688445:0:25428:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788941184.836025:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941185.412011:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102312192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941185.412128:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941185.412184:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102312192 00000100:00100000:2.0:1788941185.412192:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102312192 00000100:00100000:2.0:1788941185.412244:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788941185.412253:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102312192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788941185.412287:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788941185.412328:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102312192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941185.412335:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788941185.412355:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102312320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941185.412391:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941185.412446:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102312192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941185.412461:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102312320 00000100:00100000:0.0:1788941185.412475:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102312320 00000100:00100000:0.0:1788941185.412505:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788941185.412512:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102312320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788941185.412530:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941185.412620:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102312320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941185.412626:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788941185.412670:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941185.412677:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102312448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941185.412702:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941185.416413:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfeb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102312320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941185.416457:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102312448 00000100:00100000:2.0:1788941185.417753:0:24206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102312448 00000100:00080000:0.0:1788941185.417855:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941185.417881:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788941185.417957:0:24206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102312448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788941185.417982:0:24206:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941185.418067:0:24206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102312448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (5364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941185.418090:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbc9a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102312448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941185.418132:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00000004:3.0:1788941185.666494:0:25479:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788941185.666741:0:25479:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788941185.860134:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941186.032598:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.033663:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075976064 00000100:00100000:2.0:1788941186.033676:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075976064 00000100:00100000:2.0:1788941186.033731:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:2.0:1788941186.033752:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2402:x1875840075976064:12345-192.168.201.42@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788941186.033780:0:22691:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from a79c71a8-4021-46b6-985c-4d69e840c681@192.168.201.42@tcp t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:2.0:1788941186.033812:0:22691:0:(genops.c:1384:class_connect()) connect: client a79c71a8-4021-46b6-985c-4d69e840c681, cookie 0x24b6539075b3f0ce 00000100:00080000:2.0:1788941186.033998:0:22691:0:(import.c:65:import_set_state_nolock()) ffff99cac6452800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941186.034079:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+5:2402:x1875840075976064:12345-192.168.201.42@tcp:250:mount.lustre.0 Request processed in 327us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.034088:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788941186.049944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.053256:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075976192 00000100:00100000:1.0:1788941186.053271:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075976192 00000100:00100000:1.0:1788941186.053469:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788941186.053481:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+5:18107:x1875840075976192:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788941186.053500:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941186.053519:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cacb80c800/0x24b6539075b3f0d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c940801519f8 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.053566:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cacb80c800/0x24b6539075b3f0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801519f8 expref: 6 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.053578:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cacb80c800/0x24b6539075b3f0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801519f8 expref: 6 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.053587:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80c800, rc 0) 00000100:00100000:1.0:1788941186.053893:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+6:18107:x1875840075976192:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 413us (3958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.053900:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:3.0:1788941186.058272:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.062265:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075976320 00000100:00100000:1.0:1788941186.062282:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075976320 00000100:00100000:1.0:1788941186.062376:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:1.0:1788941186.062387:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+6:18107:x1875840075976320:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788941186.062546:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+6:18107:x1875840075976320:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 161us (4286us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788941186.062554:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:0.0:1788941186.076766:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.076975:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075976448 00000100:00100000:1.0:1788941186.076986:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075976448 00000100:00100000:1.0:1788941186.077046:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:1.0:1788941186.077057:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+6:18107:x1875840075976448:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788941186.077075:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941186.077096:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cacb80c000/0x24b6539075b3f0dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c940801519ff expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.077128:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cacb80c000/0x24b6539075b3f0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801519ff expref: 7 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.077148:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cacb80c000/0x24b6539075b3f0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c940801519ff expref: 7 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.077158:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80c000, rc 0) 00000100:00100000:1.0:1788941186.077225:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+7:18107:x1875840075976448:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 169us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.077232:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:3.0:1788941186.082573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.082780:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075976576 00000100:00100000:2.0:1788941186.082791:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075976576 00000100:00100000:2.0:1788941186.082879:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:2.0:1788941186.082891:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+7:18107:x1875840075976576:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788941186.083053:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+8:18107:x1875840075976576:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 163us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.083060:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:0.0:1788941186.086135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941186.086301:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075976704 00000100:00100000:3.0:1788941186.086312:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075976704 00000100:00100000:3.0:1788941186.086526:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788941186.086538:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+8:18107:x1875840075976704:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788941186.086707:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+8:18107:x1875840075976704:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 171us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941186.086715:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:0.0:1788941186.092583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.092687:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075976832 00000100:00100000:1.0:1788941186.092697:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075976832 00000100:00100000:1.0:1788941186.092764:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:1.0:1788941186.092774:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+8:18126:x1875840075976832:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788941186.092987:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+8:18126:x1875840075976832:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 214us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.092995:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:0.0:1788941186.152750:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.157710:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075976960 00000100:00100000:2.0:1788941186.157727:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075976960 00000100:00100000:2.0:1788941186.157801:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:2.0:1788941186.157812:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+8:18126:x1875840075976960:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788941186.158027:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+8:18126:x1875840075976960:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 216us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.158044:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:0.0:1788941186.173239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941186.173489:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075977088 00000100:00100000:3.0:1788941186.173501:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075977088 00000100:00100000:3.0:1788941186.173581:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:3.0:1788941186.173593:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+8:18126:x1875840075977088:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788941186.173784:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+8:18126:x1875840075977088:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 191us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941186.173795:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788941186.183075:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.183186:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075977216 00000100:00100000:1.0:1788941186.183196:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075977216 00000100:00100000:1.0:1788941186.183249:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:1.0:1788941186.183259:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+8:18107:x1875840075977216:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788941186.183276:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941186.183294:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cacb80ca00/0x24b6539075b3f0e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c94080151a30 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.183321:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cacb80ca00/0x24b6539075b3f0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a30 expref: 9 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.183332:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cacb80ca00/0x24b6539075b3f0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a30 expref: 9 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941186.183353:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80ca00, rc 0) 00000100:00100000:1.0:1788941186.183408:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+9:18107:x1875840075977216:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 151us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.183415:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:0.0:1788941186.193987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.194096:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075977344 00000100:00100000:2.0:1788941186.194108:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075977344 00000100:00100000:2.0:1788941186.194170:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:2.0:1788941186.194182:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+9:18107:x1875840075977344:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788941186.194210:0:22691:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788941186.194240:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788941186.194244:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788941186.194248:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788941186.194251:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788941186.194253:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788941186.209647:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+9:18107:x1875840075977344:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 15453us (15660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.209665:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:0.0:1788941186.223100:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941186.223221:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075977472 00000100:00100000:3.0:1788941186.223232:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075977472 00000100:00100000:3.0:1788941186.223297:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:3.0:1788941186.223307:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+9:18107:x1875840075977472:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788941186.223325:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941186.223344:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c94080151a37 expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941186.223376:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 10 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941186.223388:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 10 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941186.223396:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f41600, rc 0) 00000100:00100000:3.0:1788941186.223467:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+10:18107:x1875840075977472:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 162us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941186.223474:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:0.0:1788941186.228563:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.228991:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075977600 00000100:00100000:2.0:1788941186.229003:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075977600 00000100:00100000:2.0:1788941186.229067:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:2.0:1788941186.229078:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+10:18107:x1875840075977600:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788941186.229242:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+10:18107:x1875840075977600:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 166us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.229250:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:2.0:1788941186.236369:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941186.237903:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075977728 00000100:00100000:3.0:1788941186.237916:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075977728 00000100:00100000:3.0:1788941186.237977:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:3.0:1788941186.237987:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+10:18107:x1875840075977728:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788941186.238142:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+10:18107:x1875840075977728:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 155us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941186.238151:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:0.0:1788941186.245040:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.245156:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075977856 00000100:00100000:1.0:1788941186.245166:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075977856 00000100:00100000:1.0:1788941186.245229:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:1.0:1788941186.245239:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+10:18132:x1875840075977856:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788941186.245426:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+10:18132:x1875840075977856:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 188us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.245435:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:0.0:1788941186.252502:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.252606:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075977984 00000100:00100000:2.0:1788941186.252617:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075977984 00000100:00100000:2.0:1788941186.252677:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:2.0:1788941186.252687:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+10:18132:x1875840075977984:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788941186.253164:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+10:18132:x1875840075977984:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 478us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.253172:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:2.0:1788941186.276113:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.284681:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075978112 00000100:00100000:1.0:1788941186.284698:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075978112 00000100:00100000:1.0:1788941186.284916:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788941186.284925:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1875840075978112:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788941186.284955:0:22698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 31675bd2-e013-440d-8bcf-f5ceaf85e2d2@192.168.201.42@tcp t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:1.0:1788941186.285008:0:22698:0:(genops.c:1384:class_connect()) connect: client 31675bd2-e013-440d-8bcf-f5ceaf85e2d2, cookie 0x24b6539075b3f0f1 00000004:00100000:1.0:1788941186.285035:0:22698:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788941186.285255:0:22698:0:(import.c:65:import_set_state_nolock()) ffff99cbca6af800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941186.285547:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2402:x1875840075978112:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 621us (9446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.285555:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788941186.291148:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.291256:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075978368 00000100:00100000:2.0:1788941186.291267:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075978368 00000100:00100000:2.0:1788941186.291329:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788941186.291337:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1875840075978368:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788941186.291371:0:22697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 31675bd2-e013-440d-8bcf-f5ceaf85e2d2@192.168.201.42@tcp t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:2.0:1788941186.291426:0:22697:0:(genops.c:1384:class_connect()) connect: client 31675bd2-e013-440d-8bcf-f5ceaf85e2d2, cookie 0x24b6539075b3f0f8 00000004:00100000:2.0:1788941186.291450:0:22697:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788941186.291651:0:22697:0:(import.c:65:import_set_state_nolock()) ffff99cac6455800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941186.291740:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2402:x1875840075978368:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 394us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.291748:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788941186.300031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941186.300076:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941186.300117:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.300282:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075978624 00000100:00100000:1.0:1788941186.300304:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075978624 00000100:00100000:1.0:1788941186.300388:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075978496 00000100:00100000:1.0:1788941186.300392:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075978496 00000100:00100000:1.0:1788941186.300407:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075978240 00000100:00100000:1.0:1788941186.300409:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075978240 00000100:00100000:1.0:1788941186.300424:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788941186.300435:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18107:x1875840075978624:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788941186.300472:0:22698:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941186.301089:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18107:x1875840075978624:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 653us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.301098:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788941186.301123:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788941186.301131:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:0:x1875840075978496:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788941186.301145:0:22698:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941186.301181:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:0:x1875840075978496:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 52us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.301187:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788941186.301199:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:1.0:1788941186.301205:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:0:x1875840075978240:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788941186.301215:0:22698:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941186.301234:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:0:x1875840075978240:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 30us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.301240:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00080000:0.0:1788941186.302377:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788941186.302384:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788941186.315191:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941186.315261:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075978752 00000100:00100000:1.0:1788941186.315272:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075978752 00000100:00100000:1.0:1788941186.315346:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:1.0:1788941186.315357:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18107:x1875840075978752:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788941186.315571:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18107:x1875840075978752:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 215us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941186.315579:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:1.0:1788941186.326253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941186.326454:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075979136 00000100:00100000:3.0:1788941186.326467:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075979136 00000100:00100000:3.0:1788941186.326531:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788941186.326543:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18107:x1875840075979136:12345-192.168.201.42@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788941186.326703:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18107:x1875840075979136:12345-192.168.201.42@tcp:900:mount.lustre.0 Request processed in 162us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941186.326711:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:0.0:1788941186.350609:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941186.352122:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.359248:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075978880 00000100:00100000:2.0:1788941186.359266:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075978880 00000100:00100000:2.0:1788941186.359330:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075979008 00000100:00100000:2.0:1788941186.359334:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075979008 00000100:00100000:2.0:1788941186.360712:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788941186.360727:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875840075978880:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788941186.360810:0:24203:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 31675bd2-e013-440d-8bcf-f5ceaf85e2d2@192.168.201.42@tcp t0 exp 0000000000000000 cur 795 last 0 00000020:00000080:2.0:1788941186.360873:0:24203:0:(genops.c:1384:class_connect()) connect: client 31675bd2-e013-440d-8bcf-f5ceaf85e2d2, cookie 0x24b6539075b3f0ff 00002000:00100000:2.0:1788941186.360887:0:24203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 31675bd2-e013-440d-8bcf-f5ceaf85e2d2/ffff99cac6456000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788941186.360911:0:24203:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788941186.361158:0:24203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788941186.361201:0:24203:0:(import.c:65:import_set_state_nolock()) ffff99cac6453800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941186.361293:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2402:x1875840075978880:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 567us (10699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.361301:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788941186.361326:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788941186.361332:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875840075979008:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788941186.361349:0:24203:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 31675bd2-e013-440d-8bcf-f5ceaf85e2d2@192.168.201.42@tcp t0 exp 0000000000000000 cur 795 last 0 00000020:00000080:2.0:1788941186.361375:0:24203:0:(genops.c:1384:class_connect()) connect: client 31675bd2-e013-440d-8bcf-f5ceaf85e2d2, cookie 0x24b6539075b3f106 00002000:00100000:2.0:1788941186.361381:0:24203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 31675bd2-e013-440d-8bcf-f5ceaf85e2d2/ffff99cac6454000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788941186.361392:0:24203:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788941186.361482:0:24203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788941186.361509:0:24203:0:(import.c:65:import_set_state_nolock()) ffff99cac6450000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941186.361534:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2402:x1875840075979008:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 201us (9420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.361541:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:3.0:1788941186.362300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941186.362481:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075979264 00000100:00100000:3.0:1788941186.362489:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075979264 00000100:00100000:3.0:1788941186.362545:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:3.0:1788941186.362554:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18107:x1875840075979264:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788941186.363714:0:22699:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1085us 00000004:00200000:0.0:1788941186.391816:0:22699:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788941186.392112:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18107:x1875840075979264:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 29552us (29807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941186.392126:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000040:00080000:3.0:1788941186.436709:0:23449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788941186.580346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941186.580412:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075979392 00000100:00100000:2.0:1788941186.580422:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075979392 00000100:00100000:2.0:1788941186.580487:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788941186.580499:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18155:x1875840075979392:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:2.0:1788941186.580521:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941186.580548:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5e00/0x24b6539075b3f10d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151a68 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941186.580613:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f114 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941186.580640:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941186.580655:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941186.580705:0:22697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788941186.580708:0:22697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788941186.580743:0:22697:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941186.580768:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5e00/0x24b6539075b3f10d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a68 expref: 8 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941186.580785:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a68 expref: 7 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941186.580794:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbcb9c4400) 00010000:00010000:2.0:1788941186.580796:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788941186.580800:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec5800, rc 0) 00000100:00100000:2.0:1788941186.581075:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18155:x1875840075979392:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 576us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941186.581082:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00010000:00010000:1.0:1788941186.884200:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941187.908481:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941188.372040:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.382783:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075979520 00000100:00100000:0.0:1788941188.382800:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075979520 00000100:00100000:0.0:1788941188.382923:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:0.0:1788941188.382934:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18207:x1875840075979520:12345-192.168.201.42@tcp:41:lfs.0 00000004:00000024:0.0:1788941188.382973:0:22696:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788941188.383081:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18207:x1875840075979520:12345-192.168.201.42@tcp:41:lfs.0 Request processed in 148us (11052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.383089:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00080000:1.0:1788941188.383305:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788941188.388781:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.388961:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075979648 00000100:00100000:2.0:1788941188.388974:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075979648 00000100:00100000:2.0:1788941188.389058:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788941188.389071:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18207:x1875840075979648:12345-192.168.201.42@tcp:41:lfs.0 00000100:00080000:1.0:1788941188.389114:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1788941188.389141:0:22697:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788941188.389243:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18207:x1875840075979648:12345-192.168.201.42@tcp:41:lfs.0 Request processed in 175us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.389251:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788941188.393100:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.393217:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075979776 00000100:00100000:0.0:1788941188.393227:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075979776 00000100:00080000:1.0:1788941188.393293:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788941188.393317:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788941188.393328:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18207:x1875840075979776:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:0.0:1788941188.393370:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941188.393456:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18207:x1875840075979776:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 130us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.393464:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788941188.401044:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.401455:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075979904 00000100:00100000:0.0:1788941188.401465:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075979904 00000100:00100000:0.0:1788941188.401543:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:0.0:1788941188.401554:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18207:x1875840075979904:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:0.0:1788941188.401585:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788941188.401666:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18207:x1875840075979904:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 114us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.401673:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00080000:1.0:1788941188.402553:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788941188.641903:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941188.643328:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075980032 00000100:00100000:1.0:1788941188.643341:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075980032 00000100:00100000:1.0:1788941188.643417:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:1.0:1788941188.643428:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+10:18240:x1875840075980032:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788941188.643455:0:22688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941188.643475:0:22688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cacb80d200/0x24b6539075b3f11b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c94080151a6f expref: -99 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941188.643505:0:22688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cacb80d200/0x24b6539075b3f11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a6f expref: 11 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941188.643516:0:22688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cacb80d200/0x24b6539075b3f11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a6f expref: 11 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941188.643525:0:22688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80d200, rc 0) 00000100:00100000:1.0:1788941188.643587:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+11:18240:x1875840075980032:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 161us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941188.643595:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:3.0:1788941188.645142:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.645209:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075980160 00000100:00100000:2.0:1788941188.645218:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075980160 00000100:00100000:2.0:1788941188.645259:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:2.0:1788941188.645268:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+11:18240:x1875840075980160:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788941188.645417:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+11:18240:x1875840075980160:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 150us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.645424:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:3.0:1788941188.647517:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.647869:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075980288 00000100:00100000:2.0:1788941188.647882:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075980288 00000100:00100000:2.0:1788941188.647948:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:2.0:1788941188.647968:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+11:18240:x1875840075980288:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788941188.648129:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+11:18240:x1875840075980288:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 172us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.648138:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:3.0:1788941188.653224:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941188.653496:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075980416 00000100:00100000:1.0:1788941188.653529:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075980416 00000100:00100000:1.0:1788941188.653596:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:1.0:1788941188.653607:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+11:18246:x1875840075980416:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788941188.653796:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+11:18246:x1875840075980416:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 190us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941188.653815:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:3.0:1788941188.667136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.675723:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075980544 00000100:00100000:0.0:1788941188.675737:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075980544 00000100:00100000:0.0:1788941188.675796:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:0.0:1788941188.675817:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+11:18246:x1875840075980544:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788941188.676023:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+11:18246:x1875840075980544:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 207us (8896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.676032:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:3.0:1788941188.683113:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.683319:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075980672 00000100:00100000:2.0:1788941188.683330:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075980672 00000100:00100000:2.0:1788941188.683380:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:2.0:1788941188.683390:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+11:18246:x1875840075980672:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788941188.683546:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+11:18246:x1875840075980672:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 156us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.683555:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:3.0:1788941188.687887:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.688116:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075980800 00000100:00100000:0.0:1788941188.688125:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075980800 00000100:00100000:0.0:1788941188.688183:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:0.0:1788941188.688194:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+11:18240:x1875840075980800:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788941188.688211:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941188.688241:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09a400/0x24b6539075b3f122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c94080151aa0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.688276:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09a400/0x24b6539075b3f122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa0 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.688288:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09a400/0x24b6539075b3f122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa0 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.688296:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09a400, rc 0) 00000100:00100000:0.0:1788941188.688356:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+12:18240:x1875840075980800:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 164us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.688363:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:3.0:1788941188.695921:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.698287:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075980928 00000100:00100000:0.0:1788941188.698311:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075980928 00000100:00100000:0.0:1788941188.698382:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:0.0:1788941188.698391:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+12:18240:x1875840075980928:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788941188.698419:0:22691:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788941188.698448:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788941188.698453:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788941188.698456:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788941188.698459:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788941188.698462:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788941188.708276:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+12:18240:x1875840075980928:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 9875us (12359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.708290:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:3.0:1788941188.711554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.712092:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075981056 00000100:00100000:2.0:1788941188.712101:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075981056 00000100:00100000:2.0:1788941188.712165:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:2.0:1788941188.712175:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac687d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+12:18240:x1875840075981056:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788941188.712193:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941188.712210:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c94080151aa7 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941188.712249:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 13 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941188.712261:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 13 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941188.712270:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec5e00, rc 0) 00000100:00100000:2.0:1788941188.712324:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac687d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+13:18240:x1875840075981056:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 150us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.712331:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:3.0:1788941188.716082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.716323:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075981184 00000100:00100000:0.0:1788941188.716333:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075981184 00000100:00100000:0.0:1788941188.716434:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:0.0:1788941188.716444:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+13:18240:x1875840075981184:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788941188.716602:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+13:18240:x1875840075981184:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 159us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.716610:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:3.0:1788941188.721168:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.721300:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075981312 00000100:00100000:2.0:1788941188.721309:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075981312 00000100:00100000:2.0:1788941188.721359:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:2.0:1788941188.721368:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+13:18240:x1875840075981312:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788941188.721508:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+13:18240:x1875840075981312:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 140us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.721516:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:3.0:1788941188.743636:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.744083:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075981440 00000100:00100000:0.0:1788941188.744094:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075981440 00000100:00100000:0.0:1788941188.744151:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:0.0:1788941188.744160:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+13:18251:x1875840075981440:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788941188.744332:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+13:18251:x1875840075981440:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 173us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.744340:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:3.0:1788941188.749730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941188.749866:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075981568 00000100:00100000:1.0:1788941188.749877:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075981568 00000100:00100000:1.0:1788941188.749926:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:1.0:1788941188.749936:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+13:18251:x1875840075981568:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788941188.750089:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+13:18251:x1875840075981568:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 153us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941188.750097:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:3.0:1788941188.761091:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941188.761137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.761246:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075981696 00000100:00100000:2.0:1788941188.761256:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075981696 00000100:00100000:2.0:1788941188.761318:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075981952 00000100:00100000:2.0:1788941188.761321:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075981952 00000100:00100000:2.0:1788941188.761336:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788941188.761343:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1875840075981696:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788941188.761374:0:22697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c@192.168.201.42@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:2.0:1788941188.761446:0:22697:0:(genops.c:1384:class_connect()) connect: client 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c, cookie 0x24b6539075b3f130 00000004:00100000:2.0:1788941188.761470:0:22697:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788941188.761560:0:22697:0:(import.c:65:import_set_state_nolock()) ffff99cac68fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941188.761631:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2402:x1875840075981696:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 287us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.761639:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788941188.761655:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:2.0:1788941188.761659:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1875840075981952:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788941188.761675:0:22697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c@192.168.201.42@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:2.0:1788941188.761695:0:22697:0:(genops.c:1384:class_connect()) connect: client 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c, cookie 0x24b6539075b3f137 00000004:00100000:2.0:1788941188.761705:0:22697:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788941188.761743:0:22697:0:(import.c:65:import_set_state_nolock()) ffff99cac68fa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941188.761765:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2402:x1875840075981952:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 104us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.761771:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788941188.767695:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941188.767739:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941188.767821:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.767945:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075981824 00000100:00100000:2.0:1788941188.767956:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075981824 00000100:00100000:2.0:1788941188.768021:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075982208 00000100:00100000:2.0:1788941188.768024:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075982208 00000100:00100000:2.0:1788941188.768036:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075982080 00000100:00100000:2.0:1788941188.768038:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075982080 00000100:00100000:2.0:1788941188.768058:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:2.0:1788941188.768083:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+7:0:x1875840075981824:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788941188.768120:0:22697:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788941188.768188:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+7:0:x1875840075981824:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 106us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.768195:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:2.0:1788941188.768213:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788941188.768219:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18240:x1875840075982208:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788941188.768245:0:22697:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788941188.768267:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18240:x1875840075982208:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 49us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.768274:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788941188.768286:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788941188.768292:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:0:x1875840075982080:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788941188.768303:0:22697:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788941188.768327:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:0:x1875840075982080:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 35us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.768334:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00080000:0.0:1788941188.769111:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788941188.769118:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788941188.779186:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941188.779606:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075982336 00000100:00100000:2.0:1788941188.779616:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075982336 00000100:00100000:2.0:1788941188.779676:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:2.0:1788941188.779686:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18240:x1875840075982336:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788941188.779791:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18240:x1875840075982336:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 106us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.779806:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788941188.782274:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941188.782324:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941188.782365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.782917:0:25391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075982464 00000100:00100000:0.0:1788941188.782928:0:25391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075982464 00000100:00100000:0.0:1788941188.782976:0:25391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075982592 00000100:00100000:0.0:1788941188.782979:0:25391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075982592 00000100:00100000:0.0:1788941188.783000:0:25391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788941188.783008:0:25391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875840075982464:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788941188.783042:0:25391:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c@192.168.201.42@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:0.0:1788941188.783093:0:25391:0:(genops.c:1384:class_connect()) connect: client 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c, cookie 0x24b6539075b3f13e 00002000:00100000:0.0:1788941188.783104:0:25391:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c/ffff99cbd5cc3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788941188.783116:0:25391:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788941188.783185:0:25391:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788941188.783244:0:25391:0:(import.c:65:import_set_state_nolock()) ffff99cac6991000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941188.783381:0:25391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2402:x1875840075982464:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 371us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.783389:0:25391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788941188.783417:0:25391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788941188.783422:0:25391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875840075982592:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788941188.783437:0:25391:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c@192.168.201.42@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:0.0:1788941188.783452:0:25391:0:(genops.c:1384:class_connect()) connect: client 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c, cookie 0x24b6539075b3f145 00002000:00100000:0.0:1788941188.783456:0:25391:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c/ffff99cac6997800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788941188.783461:0:25391:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788941188.783487:0:25391:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788941188.783500:0:25391:0:(import.c:65:import_set_state_nolock()) ffff99cac6992800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941188.783925:0:25391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2402:x1875840075982592:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 500us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.783933:0:25391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788941188.785882:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075982720 00000100:00100000:2.0:1788941188.785899:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075982720 00000100:00100000:2.0:1788941188.785976:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:2.0:1788941188.785987:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18240:x1875840075982720:12345-192.168.201.42@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788941188.786087:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18240:x1875840075982720:12345-192.168.201.42@tcp:900:mount.lustre.0 Request processed in 102us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.786096:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:3.0:1788941188.788681:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941188.788864:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075982848 00000100:00100000:1.0:1788941188.788876:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075982848 00000100:00100000:1.0:1788941188.788923:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:1.0:1788941188.788933:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18240:x1875840075982848:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788941188.789042:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788941188.789130:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18240:x1875840075982848:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 198us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941188.789139:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00010000:00010000:1.0:1788941188.933347:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941188.942554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941188.942664:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075982976 00000100:00100000:0.0:1788941188.942676:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075982976 00000100:00100000:0.0:1788941188.942763:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788941188.942772:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18274:x1875840075982976:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:0.0:1788941188.942808:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941188.942893:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ae00/0x24b6539075b3f14c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151ad8 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.942966:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.942979:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.942991:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941188.943034:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788941188.943038:0:22696:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941188.943057:0:22696:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.943080:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ae00/0x24b6539075b3f14c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 8 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.943096:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 7 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941188.943103:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbcb9c4400) 00010000:00010000:0.0:1788941188.943105:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788941188.943108:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09ac00, rc 0) 00000100:00100000:0.0:1788941188.943184:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+7:18274:x1875840075982976:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 412us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.943192:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788941188.996732:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788941188.996758:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102312576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788941188.996864:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941188.997052:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102312704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788941188.997080:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941188.997110:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102312576 00000100:00100000:1.0:1788941188.997130:0:24206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102312576 00000100:00100000:1.0:1788941188.997177:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102312704 00000100:00100000:1.0:1788941188.997180:0:24206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102312704 00000100:00100000:1.0:1788941188.997196:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941188.997204:0:24206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875840102312576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788941188.997226:0:24206:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788941188.997265:0:24206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875840102312576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941188.997272:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941188.997289:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941188.997294:0:24206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102312704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788941188.997428:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102312576:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788941188.997472:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788941188.997521:0:24206:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788941188.997545:0:24206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102312704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 252us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941188.997552:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941188.997584:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102312704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941188.997892:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102313088:0@lo:400:kworker.0 00000100:00100000:3.0:1788941188.997934:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941188.997958:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875840102313600:0@lo:400:kworker.0 00000100:00100000:3.0:1788941188.997982:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941188.997998:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875840102314112:0@lo:400:kworker.0 00000100:00100000:3.0:1788941188.998020:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941188.998047:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788941188.998052:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102312960:0@lo:400:kworker.0 00000100:00100000:3.0:1788941188.998072:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941188.998092:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102313472:0@lo:400:kworker.0 00000100:00100000:3.0:1788941188.998111:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941188.998123:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875840102313984:0@lo:400:kworker.0 00000100:00100000:3.0:1788941188.998140:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941188.998483:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102313600 00000100:00100000:0.0:1788941188.998495:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102313600 00000100:00100000:0.0:1788941188.998521:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102314112 00000100:00100000:0.0:1788941188.998523:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102314112 00000100:00100000:0.0:1788941188.998548:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102313984 00000100:00100000:0.0:1788941188.998551:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102313984 00000100:00100000:0.0:1788941188.998563:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788941188.998569:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875840102313600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941188.998614:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875840102313600:12345-0@lo:400:kworker.0 Request processed in 44us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.998620:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788941188.998632:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788941188.998636:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875840102314112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941188.998657:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875840102314112:12345-0@lo:400:kworker.0 Request processed in 21us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.998662:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788941188.998669:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788941188.998673:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875840102313984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941188.998692:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875840102313984:12345-0@lo:400:kworker.0 Request processed in 18us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.998697:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788941188.998729:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875840102313984:0@lo:400:kworker.0 00000100:00100000:0.0:1788941188.998740:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875840102313600:0@lo:400:kworker.0 00010000:00080000:0.0:1788941188.998756:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac7df0000 x1875840102314112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941188.998765:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875840102314112:0@lo:400:kworker.0 00000100:00100000:0.0:1788941188.998810:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102313088 00000100:00100000:0.0:1788941188.998814:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102313088 00000100:00100000:0.0:1788941188.998864:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102313472 00000100:00100000:0.0:1788941188.998868:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102313472 00000100:00100000:0.0:1788941188.998886:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941188.998892:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102313088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941188.998935:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102313088:12345-0@lo:400:kworker.0 Request processed in 43us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.998941:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941188.998952:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788941188.998958:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102313472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941188.998983:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102313472:12345-0@lo:400:kworker.0 Request processed in 25us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941188.998988:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788941188.999011:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102313472:0@lo:400:kworker.0 00000100:00100000:0.0:1788941188.999022:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102313088:0@lo:400:kworker.0 00000100:00100000:1.0:1788941188.999268:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102313216:0@lo:400:kworker.0 00000100:00100000:1.0:1788941188.999442:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941188.999472:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875840102313728:0@lo:400:kworker.0 00000100:00100000:1.0:1788941188.999497:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941188.999511:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788941188.999518:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102312832:0@lo:400:kworker.0 00000100:00100000:2.0:1788941188.999651:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102312960 00000100:00100000:2.0:1788941188.999657:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102312960 00000100:00100000:2.0:1788941188.999691:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788941188.999699:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102312960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941188.999741:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102312960:12345-0@lo:400:kworker.0 Request processed in 44us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.999747:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788941188.999784:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102312960:0@lo:400:kworker.0 00000100:00100000:2.0:1788941188.999814:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102313216 00000100:00100000:2.0:1788941188.999818:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102313216 00000100:00100000:2.0:1788941188.999856:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102313728 00000100:00100000:2.0:1788941188.999860:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102313728 00000100:00100000:2.0:1788941188.999880:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788941188.999886:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102313216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941188.999936:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875840102313216:12345-0@lo:400:kworker.0 Request processed in 50us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.999942:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788941188.999955:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788941188.999961:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875840102313728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941188.999985:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875840102313728:12345-0@lo:400:kworker.0 Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941188.999991:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788941189.000403:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941189.000434:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102313344:0@lo:400:kworker.0 00000100:00100000:1.0:1788941189.000455:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941189.000481:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875840102313856:0@lo:400:kworker.0 00000100:00100000:1.0:1788941189.000500:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941189.000519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbfea7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875840102313216:0@lo:400:kworker.0 00000100:00100000:1.0:1788941189.000528:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875840102313728:0@lo:400:kworker.0 00000100:00100000:1.0:1788941189.000551:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102313344 00000100:00100000:1.0:1788941189.000554:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102313344 00000100:00100000:1.0:1788941189.000575:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788941189.000580:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102313344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941189.000611:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102313344:12345-0@lo:400:kworker.0 Request processed in 30us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941189.000617:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788941189.000642:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102313344:0@lo:400:kworker.0 00000100:00100000:0.0:1788941189.000710:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102313856 00000100:00100000:0.0:1788941189.000714:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102313856 00000100:00100000:0.0:1788941189.000751:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788941189.000758:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875840102313856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941189.000792:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875840102313856:12345-0@lo:400:kworker.0 Request processed in 35us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941189.000810:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788941189.000875:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788941189.000881:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941189.000883:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788941189.001012:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102312832 00000100:00100000:2.0:1788941189.001016:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102312832 00000100:00100000:2.0:1788941189.001050:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788941189.001056:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3649:x1875840102312832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941189.001085:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3649:x1875840102312832:12345-0@lo:400:kworker.0 Request processed in 30us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941189.001091:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788941189.001404:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe56e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102312832:0@lo:400:kworker.0 00010000:00080000:1.0:1788941189.001417:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac7df1c00 x1875840102313856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941189.001428:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875840102313856:0@lo:400:kworker.0 00000100:00100000:1.0:1788941189.508174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102314240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788941189.508253:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941189.508544:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102314240 00000100:00100000:2.0:1788941189.508552:0:24206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102314240 00000100:00100000:2.0:1788941189.508670:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941189.508680:0:24206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102314240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788941189.508711:0:24206:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941189.508944:0:24206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102314240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 265us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941189.508952:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788941189.509269:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102314240:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788941189.963493:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788941190.213546:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788941190.533618:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788941190.533642:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102314368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941190.533722:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941190.533927:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102314496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788941190.533968:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941190.534011:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102314368 00000100:00100000:0.0:1788941190.534020:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102314368 00000100:00100000:0.0:1788941190.534078:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788941190.534087:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102314368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788941190.534116:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941190.534170:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102314368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941190.534177:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788941190.534199:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788941190.534219:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102314496 00000100:00100000:0.0:1788941190.534223:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102314496 00000100:00100000:0.0:1788941190.534246:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788941190.534253:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102314496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788941190.534277:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941190.534311:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102314496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941190.534317:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788941190.534357:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102314496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941190.534453:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102314368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941190.536232:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788941190.536252:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102314624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941190.536314:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941190.536430:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102314624 00000100:00100000:3.0:1788941190.536438:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102314624 00000100:00100000:3.0:1788941190.536488:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788941190.536498:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102314624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788941190.536528:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788941190.536586:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102314624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941190.536593:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788941190.537159:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102314624:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788941190.537418:0:25018:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c 00000001:00100000:0.0:1788941190.537426:0:25018:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 31675bd2-e013-440d-8bcf-f5ceaf85e2d2 00000001:00080000:0.0:1788941190.537434:0:25018:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1788941190.979935:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788941191.501440:0:25576:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788941192.004090:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788941192.079731:0:23429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c 00000001:00100000:2.0:1788941192.079871:0:23429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 31675bd2-e013-440d-8bcf-f5ceaf85e2d2 00000001:00100000:2.0:1788941192.086181:0:24199:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c 00000001:00100000:2.0:1788941192.086196:0:24199:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 31675bd2-e013-440d-8bcf-f5ceaf85e2d2 00000001:00100000:2.0:1788941192.086749:0:22676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c8bf894-fc68-4f81-b82b-b4b6edc81d8c 00000001:00100000:2.0:1788941192.086758:0:22676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 31675bd2-e013-440d-8bcf-f5ceaf85e2d2 00010000:00010000:1.0:1788941193.034215:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941194.053199:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941194.116065:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102314752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788941194.116160:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941194.116287:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102314752 00000100:00100000:0.0:1788941194.116298:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102314752 00000100:00100000:0.0:1788941194.116361:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941194.116372:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102314752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788941194.116408:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788941194.116457:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875840102314752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941194.116464:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941194.116503:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788941194.116526:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875840102314752:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788941194.116659:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788941194.116771:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe7741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102314880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941194.116802:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941194.116924:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102314880 00000100:00100000:2.0:1788941194.116930:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102314880 00000100:00100000:2.0:1788941194.116988:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788941194.116996:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102314880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788941194.117008:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788941194.117063:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102314880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.117071:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788941194.117087:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788941194.117130:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe7741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102314880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788941194.117509:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102315008:0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.117547:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941194.117592:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102315520:0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.117616:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941194.117634:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102316032:0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.117656:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941194.117683:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788941194.117689:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102315136:0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.117736:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941194.117754:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102315648:0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.117775:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941194.117792:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875840102316160:0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.117819:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941194.117952:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102315520 00000100:00100000:1.0:1788941194.117958:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102315520 00000100:00100000:1.0:1788941194.117993:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102315136 00000100:00100000:1.0:1788941194.117996:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102315136 00000100:00100000:1.0:1788941194.118019:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788941194.118027:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102315520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.118072:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102315520:12345-0@lo:400:kworker.0 Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941194.118079:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788941194.118092:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788941194.118098:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102315136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.118138:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102315136:12345-0@lo:400:kworker.0 Request processed in 41us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941194.118145:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788941194.118355:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102315136:0@lo:400:kworker.0 00000100:00100000:1.0:1788941194.118385:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102315520:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.118626:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102316032 00000100:00100000:2.0:1788941194.118631:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102316032 00000100:00100000:2.0:1788941194.118680:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102316160 00000100:00100000:2.0:1788941194.118683:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102316160 00000100:00100000:2.0:1788941194.118699:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788941194.118719:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102316032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.118769:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102316032:12345-0@lo:400:kworker.0 Request processed in 53us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.118798:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788941194.118812:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788941194.118818:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875840102316160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.118872:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875840102316160:12345-0@lo:400:kworker.0 Request processed in 54us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.118879:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788941194.118910:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102315392:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.118944:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941194.118972:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875840102315904:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.118993:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941194.119006:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788941194.119011:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102315264:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119032:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941194.119048:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102315776:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119071:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941194.119081:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875840102316288:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119100:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941194.119116:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102315392 00000100:00100000:2.0:1788941194.119120:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102315392 00000100:00100000:2.0:1788941194.119135:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102315904 00000100:00100000:2.0:1788941194.119138:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102315904 00000100:00100000:2.0:1788941194.119147:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102315776 00000100:00100000:2.0:1788941194.119149:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102315776 00000100:00100000:2.0:1788941194.119160:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102316288 00000100:00100000:2.0:1788941194.119168:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102316288 00000100:00100000:2.0:1788941194.119198:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788941194.119203:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102315392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119235:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102315392:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.119241:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788941194.119261:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788941194.119267:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875840102315904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119291:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875840102315904:12345-0@lo:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.119297:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788941194.119307:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788941194.119312:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102315776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119334:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102315776:12345-0@lo:400:kworker.0 Request processed in 22us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.119340:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788941194.119351:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788941194.119356:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875840102316288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119379:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875840102316288:12345-0@lo:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.119384:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788941194.119400:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102315648 00000100:00100000:2.0:1788941194.119404:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102315648 00000100:00100000:2.0:1788941194.119426:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102315264 00000100:00100000:2.0:1788941194.119429:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102315264 00000100:00100000:2.0:1788941194.119444:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788941194.119449:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102315648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119493:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102315648:12345-0@lo:400:kworker.0 Request processed in 43us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.119499:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788941194.119510:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788941194.119515:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102315264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119538:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102315264:12345-0@lo:400:kworker.0 Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.119544:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788941194.119575:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102315264:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119586:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102315776:0@lo:400:kworker.0 00010000:00080000:2.0:1788941194.119597:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac7d49880 x1875840102316288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941194.119607:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875840102316288:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119617:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102315392:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119625:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875840102315904:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119662:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102315648:0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.119673:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875840102316160:0@lo:400:kworker.0 00010000:00080000:2.0:1788941194.119685:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cac7d4a680 x1875840102316032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941194.119695:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102316032:0@lo:400:kworker.0 00000100:00080000:1.0:1788941194.119879:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788941194.119885:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788941194.119887:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788941194.119989:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102315008 00000100:00100000:2.0:1788941194.120000:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102315008 00000100:00100000:2.0:1788941194.120049:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788941194.120057:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3651:x1875840102315008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941194.120115:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3651:x1875840102315008:12345-0@lo:400:kworker.0 Request processed in 59us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.120121:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788941194.120348:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102315008:0@lo:400:kworker.0 00000100:00100000:3.0:1788941194.177267:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177320:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177355:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177391:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177477:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177494:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177515:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177530:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941194.177594:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075983360 00000100:00100000:3.0:1788941194.177613:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075983360 00000100:00100000:3.0:1788941194.177689:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075983872 00000100:00100000:3.0:1788941194.177693:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075983872 00000100:00100000:3.0:1788941194.177724:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075983232 00000100:00100000:3.0:1788941194.177727:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075983232 00000100:00100000:3.0:1788941194.177742:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075983744 00000100:00100000:3.0:1788941194.177744:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075983744 00000100:00100000:3.0:1788941194.177760:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:3.0:1788941194.177770:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075983360:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941194.177879:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075983360:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 110us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941194.177887:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:3.0:1788941194.177905:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:3.0:1788941194.177911:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075983872:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941194.177937:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075983872:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941194.177943:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:3.0:1788941194.177954:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:3.0:1788941194.177959:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2404:x1875840075983232:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941194.177981:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2404:x1875840075983232:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941194.177996:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:3.0:1788941194.178008:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:3.0:1788941194.178013:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2404:x1875840075983744:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941194.178037:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2404:x1875840075983744:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941194.178043:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:3.0:1788941194.178143:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075983616 00000100:00100000:3.0:1788941194.178149:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075983616 00000100:00100000:3.0:1788941194.178168:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075984128 00000100:00100000:3.0:1788941194.178170:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075984128 00000100:00100000:3.0:1788941194.178180:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075983488 00000100:00100000:3.0:1788941194.178182:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075983488 00000100:00100000:3.0:1788941194.178192:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075984000 00000100:00100000:3.0:1788941194.178194:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075984000 00000100:00100000:3.0:1788941194.178207:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788941194.178213:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075983616:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941194.178248:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075983616:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941194.178254:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788941194.178267:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788941194.178273:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075984128:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941194.178294:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075984128:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941194.178300:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788941194.178310:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:3.0:1788941194.178323:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075983488:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941194.178346:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075983488:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941194.178353:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:3.0:1788941194.178365:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788941194.178372:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075984000:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941194.178393:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075984000:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941194.178399:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00080000:3.0:1788941194.178451:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788941194.178455:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788941194.178458:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941194.178459:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788941194.178599:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075983104 00000100:00100000:1.0:1788941194.178604:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075983104 00000100:00100000:1.0:1788941194.178641:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:1.0:1788941194.178659:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+13:2404:x1875840075983104:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941194.178693:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+13:2404:x1875840075983104:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941194.178699:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:0.0:1788941194.632811:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941194.632867:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102316416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788941194.632963:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941194.633351:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102316416 00000100:00100000:2.0:1788941194.633363:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102316416 00000100:00100000:2.0:1788941194.633465:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788941194.633478:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102316416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788941194.633510:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941194.633596:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102316416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941194.633603:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788941194.633874:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102316416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788941195.082677:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788941195.265807:0:25724:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc008544d0 20000000:00000080:3.0:1788941195.265861:0:25724:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cacb7fd800 uarg=0000000000000000 20000000:01000000:3.0:1788941195.265915:0:25724:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788941195.265922:0:25724:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788941195.265928:0:25724:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788941195.272699:0:25725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788941195.273035:0:25724:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788941195.279460:0:25724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788941195.279499:0:25724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.279537:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 23 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.279575:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3edbe expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.279811:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3edfd expref: 23 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.279817:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.279828:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 12 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.279953:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 12 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.279963:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.280021:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 12 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.280037:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 12 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941195.280053:0:25724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102316544:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788941195.280153:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 12 pid: 22688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.280161:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 12 pid: 22688 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941195.280178:0:25724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102316672:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788941195.280209:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.280216:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 23 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941195.280225:0:25724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7df0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102316800:0@lo:104: 00000100:00100000:3.0:1788941195.280269:0:25724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941195.280313:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3edfd expref: 23 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941195.280315:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102316800 00010000:00010000:3.0:1788941195.280320:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3edfd expref: 23 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941195.280323:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102316800 00000100:00100000:3.0:1788941195.280328:0:25724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac86e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102316928:0@lo:104: 00000100:00100000:3.0:1788941195.280349:0:25724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941195.280372:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3edbe expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941195.280372:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102316928 00000100:00100000:2.0:1788941195.280375:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102316928 00010000:00010000:3.0:1788941195.280380:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3edbe expref: 23 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941195.280389:0:25724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac86e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102317056:0@lo:104: 00000100:00100000:2.0:1788941195.280390:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788941195.280399:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:25724:x1875840102316800:12345-0@lo:104: 00000100:00100000:3.0:1788941195.280407:0:25724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788941195.280415:0:22680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.280421:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 23 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.280438:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 23 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941195.280447:0:25724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102317184:0@lo:104: 00000100:00100000:3.0:1788941195.280466:0:25724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941195.280475:0:25724:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb785d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788941195.280479:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788941195.280494:0:25724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102316800:0@lo:104: 00000100:00100000:2.0:1788941195.280717:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:25724:x1875840102316800:12345-0@lo:104: Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941195.280725:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788941195.280746:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102317056 00000100:00100000:2.0:1788941195.280755:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102317056 00000100:00100000:2.0:1788941195.280769:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102317184 00000100:00100000:2.0:1788941195.280771:0:22680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102317184 00000100:00100000:2.0:1788941195.280783:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788941195.280788:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+5:25724:x1875840102316928:12345-0@lo:104: 00010000:00010000:2.0:1788941195.280796:0:22680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.280876:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788941195.280882:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+5:25724:x1875840102316928:12345-0@lo:104: Request processed in 93us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941195.280887:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788941195.280901:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788941195.280906:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:25724:x1875840102317056:12345-0@lo:104: 00010000:00010000:2.0:1788941195.280913:0:22680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.280937:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788941195.280941:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+4:25724:x1875840102317056:12345-0@lo:104: Request processed in 36us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941195.280946:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788941195.280956:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788941195.280962:0:22680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:25724:x1875840102317184:12345-0@lo:104: 00010000:00010000:2.0:1788941195.280970:0:22680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.280993:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788941195.280998:0:22680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+3:25724:x1875840102317184:12345-0@lo:104: Request processed in 37us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941195.281010:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788941195.281026:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788941195.281033:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281040:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41000 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:2.0:1788941195.281296:0:22684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281306:0:22684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788941195.281313:0:22684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941195.281319:0:22684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788941195.281362:0:22684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281368:0:22684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788941195.281392:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281398:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7f41000/0x24b6539075b3ef7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ef85 expref: -99 pid: 25017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281413:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788941195.281417:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281433:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5c00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:2.0:1788941195.281436:0:22684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281454:0:22684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788941195.281460:0:22684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941195.281464:0:22684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788941195.281477:0:22684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281482:0:22684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788941195.281738:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281746:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cac7ec5c00/0x24b6539075b3edfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3ee04 expref: -99 pid: 24198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281755:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788941195.281759:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281764:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09b600 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:2.0:1788941195.281768:0:22684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281786:0:22684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788941195.281792:0:22684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941195.281797:0:22684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788941195.281813:0:22684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281926:0:22684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788941195.281946:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281953:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfc09b600/0x24b6539075b3edbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3edc5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281965:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941195.281968:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281973:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09aa00 already unused, calling callback (ffffffffc12a3c20) 10000000:00010000:2.0:1788941195.281976:0:22684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.281983:0:22684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788941195.281990:0:22684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941195.282001:0:22684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788941195.282015:0:22684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.282021:0:22684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788941195.282027:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.282034:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff99cbfc09aa00/0x24b6539075b3edb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b6539075b3edb7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.282047:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941195.282049:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941195.282051:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941195.282060:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941195.282074:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102317312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941195.282115:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941195.282151:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788941195.282157:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102317440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941195.282177:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941195.282294:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102317312 00000100:00100000:2.0:1788941195.282300:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102317568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941195.282300:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102317312 00010000:00010000:1.0:1788941195.282322:0:22681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 24 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941195.282323:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941195.282341:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941195.282344:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102317440 00000100:00100000:2.0:1788941195.282346:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102317696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941195.282347:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102317440 00010000:00010000:1.0:1788941195.282357:0:22681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3edfd expref: 25 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941195.282368:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102317568 00000100:00100000:1.0:1788941195.282370:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102317568 00000100:00100000:2.0:1788941195.282379:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788941195.282379:0:22681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3edbe expref: 26 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941195.282396:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102317696 00000100:00100000:1.0:1788941195.282398:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102317696 00000100:00100000:2.0:1788941195.282408:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788941195.282409:0:22681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 27 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941195.282414:0:23451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8688e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+27:3651:x1875840102317312:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941195.282420:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941195.282424:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+27:3651:x1875840102317440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941195.282430:0:23451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941195.282430:0:22681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941195.282435:0:23451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 27 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941195.282435:0:22681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3edfd expref: 27 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941195.282458:0:22681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3edfd expref: 27 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941195.282473:0:22681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941195.282510:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+27:3651:x1875840102317440:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941195.282528:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941195.282545:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941195.282552:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+26:3649:x1875840102317568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941195.282559:0:22681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941195.282563:0:22681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3edbe expref: 26 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941195.282570:0:22681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3edbe expref: 26 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941195.282578:0:22681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941195.282769:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+26:3649:x1875840102317568:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941195.282776:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941195.282789:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941195.282794:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+25:3649:x1875840102317696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941195.282801:0:22681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941195.282805:0:22681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 25 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941195.282813:0:22681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 25 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941195.282823:0:22681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941195.283221:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+25:3649:x1875840102317696:12345-0@lo:103:ldlm_bl.0 Request processed in 425us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941195.283228:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941195.283298:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102317696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941195.283307:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3649:1875840102317568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941195.283339:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102317440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941195.284022:0:23451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 24 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.284039:0:23451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbd3a29800/0x24b6539075b3ef85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3ef7e expref: 24 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.284063:0:23451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941195.284114:0:23451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8688e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:3651:x1875840102317312:12345-0@lo:103:ldlm_bl.0 Request processed in 1700us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941195.284121:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788941195.284396:0:25724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbfc09a200/0x24b6539075b3ee04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3edfd expref: 22 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941195.284409:0:25724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac86e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102316928:0@lo:104: 00010000:00010000:3.0:1788941195.284421:0:25724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3edc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3edbe expref: 21 pid: 22691 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941195.284428:0:25724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac86e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102317056:0@lo:104: 00010000:00010000:3.0:1788941195.284438:0:25724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac19a4e00/0x24b6539075b3edb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b6539075b3edb0 expref: 20 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941195.284444:0:25724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102317184:0@lo:104: 00000100:00100000:1.0:1788941195.284719:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102317312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941195.284881:0:25724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102316544:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788941195.284891:0:25724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7df3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25724:1875840102316672:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788941195.284931:0:25724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941195.291949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941195.292238:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075984256 00000100:00100000:2.0:1788941195.292251:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075984256 00010000:00010000:2.0:1788941195.292299:0:22681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 13 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941195.292345:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788941195.292358:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7f08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a79c71a8-4021-46b6-985c-4d69e840c681+13:2403:x1875840075984256:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941195.292376:0:22681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941195.292384:0:22681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 13 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.292400:0:22681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 13 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.292420:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f129 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aa7 expref: 13 pid: 22689 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.292460:0:22681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941195.292521:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7f08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a79c71a8-4021-46b6-985c-4d69e840c681+12:2403:x1875840075984256:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 165us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941195.292530:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788941195.293023:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941195.293246:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075984384 00000100:00100000:2.0:1788941195.293254:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075984384 00010000:00010000:2.0:1788941195.293273:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 12 pid: 22688 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941195.293298:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788941195.293306:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a79c71a8-4021-46b6-985c-4d69e840c681+12:2403:x1875840075984384:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941195.293315:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941195.293320:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 12 pid: 22688 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293330:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 12 pid: 22688 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293341:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f41600/0x24b6539075b3f0ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a37 expref: 12 pid: 22688 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293353:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293361:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293379:0:22683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293395:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293401:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293409:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293416:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40400 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941195.293422:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293430:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293464:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941195.293475:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941195.293522:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a79c71a8-4021-46b6-985c-4d69e840c681+11:2403:x1875840075984384:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 216us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941195.293529:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00010000:00010000:3.0:1788941195.293535:0:25724:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.293557:0:25724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941195.293563:0:25724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f15a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941195.652170:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941195.652203:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102317824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788941195.652395:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941195.652405:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102317952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941195.652528:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941195.652612:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102317952 00000100:00100000:1.0:1788941195.652640:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102317952 00000100:00100000:1.0:1788941195.652711:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788941195.652720:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102317952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941195.652781:0:22702:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941195.652866:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102317952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941195.652873:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788941195.653029:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102317952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941195.655868:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788941195.655889:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102318080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941195.655958:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941195.656004:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102318080 00000100:00100000:2.0:1788941195.656012:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102318080 00000100:00100000:2.0:1788941195.656073:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788941195.656099:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102318080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788941195.656124:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941195.656381:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102318080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 282us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941195.656390:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788941195.656440:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102318080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941195.661115:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941195.661165:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102317824 00000100:00100000:0.0:1788941195.661175:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102317824 00000100:00100000:0.0:1788941195.661225:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788941195.661484:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102317824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788941195.661654:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941195.661792:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102317824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 310us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941195.661800:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788941195.662421:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102317824:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788941196.101311:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788941196.356356:0:22693:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788941196.356365:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cac8895000 from 13 10000000:01000000:1.0:1788941196.356370:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788941196.356421:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cacb80d600/0x24b6539075b3f161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941196.356432:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cacb80d600/0x24b6539075b3f161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941196.356444:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cacb80d600/0x24b6539075b3f161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941196.356471:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac868b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.356545:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941196.356600:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941196.358797:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102318208 00000100:00100000:2.0:1788941196.358812:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102318208 00000100:00100000:2.0:1788941196.358916:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788941196.358928:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+20:22693:x1875840102318208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941196.358949:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941196.358970:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f168 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3f161 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.358997:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3f161 expref: 21 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.359008:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec5e00/0x24b6539075b3f168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3f161 expref: 21 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.359018:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec5e00, rc 0) 00000100:00100000:2.0:1788941196.359083:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102318208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941196.359089:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788941196.362721:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac868b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941196.362754:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cacb80d600/0x24b6539075b3f161 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f168 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941196.362791:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cacb80d600/0x24b6539075b3f161 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3f168 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941196.362936:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941196.363008:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941196.363059:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb70b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788941196.369336:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102318336 00000100:00100000:2.0:1788941196.369360:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102318336 00000100:00100000:2.0:1788941196.369455:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788941196.369487:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102318336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941196.369767:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102318336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (6758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941196.369776:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788941196.372407:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941196.372499:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac7d48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941196.372752:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941196.372917:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb70b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788941196.373182:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102318464 00000100:00100000:1.0:1788941196.373201:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102318464 00000100:00100000:1.0:1788941196.373357:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788941196.373391:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102318464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.373718:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102318464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 351us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941196.373733:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788941196.376045:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac7d48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788941196.384721:0:25737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788941196.384977:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788941196.385019:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788941196.385047:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cacb80d600/0x24b6539075b3f161 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f168 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941196.385073:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cacb80d600/0x24b6539075b3f161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f168 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941196.385098:0:22693:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788941196.385102:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cbc460a800 from 13 10000000:01000000:1.0:1788941196.385105:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788941196.385169:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cacb80ce00/0x24b6539075b3f16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941196.385187:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cacb80ce00/0x24b6539075b3f16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941196.385200:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cacb80ce00/0x24b6539075b3f16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941196.385249:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.385375:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941196.385446:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03480 going to sleep for 11 seconds 00000100:00100000:2.0:1788941196.385757:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102318592 00000100:00100000:2.0:1788941196.385764:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102318592 00000100:00100000:2.0:1788941196.385911:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788941196.385922:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+21:22693:x1875840102318592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941196.385976:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941196.385989:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3f176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3f16f expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.386044:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3f176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3f16f expref: 22 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.386069:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec5c00/0x24b6539075b3f176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3f16f expref: 22 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.386079:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec5c00, rc 0) 00000100:00100000:2.0:1788941196.386163:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:22693:x1875840102318592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941196.386171:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788941196.387804:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941196.387831:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cacb80ce00/0x24b6539075b3f16f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f176 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941196.387869:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cacb80ce00/0x24b6539075b3f16f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3f176 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941196.387974:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788941196.388022:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941196.388061:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb785b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941196.393360:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102318720 00000100:00100000:0.0:1788941196.393389:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102318720 00000100:00100000:0.0:1788941196.393513:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788941196.393535:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:22693:x1875840102318720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941196.393809:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:22693:x1875840102318720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (5772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941196.393817:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788941196.393988:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788941196.394043:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788941196.394106:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941196.394140:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb785b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788941196.394157:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102318848 00000100:00100000:3.0:1788941196.394161:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102318848 00000100:00100000:3.0:1788941196.394185:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788941196.394191:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:22693:x1875840102318848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788941196.394417:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:22693:x1875840102318848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941196.394431:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788941196.394581:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788941196.409677:0:25738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788941196.409920:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788941196.409945:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788941196.409958:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cacb80ce00/0x24b6539075b3f16f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f176 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941196.409972:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cacb80ce00/0x24b6539075b3f16f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f176 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941196.409984:0:22693:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788941196.409987:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cac84eb800 from 13 10000000:01000000:3.0:1788941196.409990:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788941196.410030:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40600/0x24b6539075b3f17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941196.410038:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7f40600/0x24b6539075b3f17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941196.410050:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7f40600/0x24b6539075b3f17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941196.410076:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788941196.410559:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941196.410607:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb785b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941196.414564:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102318976 00000100:00100000:0.0:1788941196.414580:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102318976 00000100:00100000:0.0:1788941196.414633:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788941196.414644:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+22:22693:x1875840102318976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941196.414698:0:22689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941196.414720:0:22689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbfc09aa00/0x24b6539075b3f184 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3f17d expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941196.414750:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbfc09aa00/0x24b6539075b3f184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3f17d expref: 23 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941196.414762:0:22689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbfc09aa00/0x24b6539075b3f184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3f17d expref: 23 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941196.414771:0:22689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09aa00, rc 0) 00000100:00100000:3.0:1788941196.415087:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102318976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941196.415121:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7f40600/0x24b6539075b3f17d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f184 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941196.415139:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7f40600/0x24b6539075b3f17d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3f184 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941196.415242:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788941196.418608:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941196.418741:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb785b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941196.421067:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102318976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6414us (10499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941196.421079:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788941196.421722:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102319104 00000100:00100000:3.0:1788941196.421734:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102319104 00000100:00100000:2.0:1788941196.421914:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788941196.421951:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102319104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941196.422131:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102319104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (3530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941196.422139:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788941196.423513:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac86e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.423575:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.423644:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941196.423690:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cac7e03480 going to sleep for 11 seconds 00000100:00100000:1.0:1788941196.423718:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102319232 00000100:00100000:1.0:1788941196.423725:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102319232 00000100:00100000:1.0:1788941196.427516:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788941196.427547:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102319232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.427914:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102319232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 383us (4270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941196.427922:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788941196.437510:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788941196.442522:0:25739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788941196.445372:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788941196.445417:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788941196.445430:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7f40600/0x24b6539075b3f17d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f184 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.445444:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7f40600/0x24b6539075b3f17d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f184 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941196.445457:0:22693:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788941196.445459:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cbe5775000 from 13 10000000:01000000:2.0:1788941196.445462:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788941196.445506:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4600/0x24b6539075b3f18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.445515:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4600/0x24b6539075b3f18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.445527:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4600/0x24b6539075b3f18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941196.445560:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788941196.445639:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941196.445701:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc2acb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941196.447368:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102319360 00000100:00100000:3.0:1788941196.447381:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102319360 00000100:00100000:3.0:1788941196.447437:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788941196.447447:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+23:22693:x1875840102319360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941196.447462:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941196.447475:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f192 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b6539075b3f18b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941196.447501:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b6539075b3f18b expref: 24 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941196.447513:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7f40400/0x24b6539075b3f192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b6539075b3f18b expref: 24 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941196.447521:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f40400, rc 0) 00000100:00100000:3.0:1788941196.447580:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:22693:x1875840102319360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941196.447598:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788941196.447968:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941196.447985:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4600/0x24b6539075b3f18b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f192 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.447994:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4600/0x24b6539075b3f18b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b6539075b3f192 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941196.448079:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941196.448124:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941196.448159:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc2acb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941196.448254:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102319488 00000100:00100000:1.0:1788941196.448260:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102319488 00000100:00100000:1.0:1788941196.455258:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788941196.455279:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:22693:x1875840102319488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.455465:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:22693:x1875840102319488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (7340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941196.455473:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788941196.455585:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941196.455646:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788941196.455707:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941196.459779:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc2acb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941196.460050:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102319616 00000100:00100000:3.0:1788941196.460061:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102319616 00000100:00100000:3.0:1788941196.460127:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788941196.460137:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:22693:x1875840102319616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788941196.467307:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:22693:x1875840102319616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7162us (11589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941196.467322:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788941196.469058:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:22693:1875840102319616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788941196.477380:0:25740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788941196.477626:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788941196.477651:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788941196.477698:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4600/0x24b6539075b3f18b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f192 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941196.477711:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff99cac7ec4600/0x24b6539075b3f18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b6539075b3f192 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788941196.678179:0:23449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788941196.738653:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941196.739551:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075984512 00000100:00100000:2.0:1788941196.739566:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075984512 00000100:00100000:2.0:1788941196.739702:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:2.0:1788941196.739716:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+11:18121:x1875840075984512:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941196.739753:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941196.739779:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3f199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c94080151adf expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.739817:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3f199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151adf expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.739828:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec4000/0x24b6539075b3f199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151adf expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.739892:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4000, rc 0) 00000100:00100000:2.0:1788941196.740005:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+12:18121:x1875840075984512:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 292us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941196.740029:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:0.0:1788941196.748216:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941196.748274:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075984640 00000100:00100000:2.0:1788941196.748285:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075984640 00000100:00100000:2.0:1788941196.748352:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 163 00000100:00100000:2.0:1788941196.748363:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+12:18121:x1875840075984640:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941196.749374:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+12:18121:x1875840075984640:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 1011us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941196.749383:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 163 00000100:00100000:0.0:1788941196.755575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941196.755791:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075984768 00000100:00100000:1.0:1788941196.755803:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075984768 00000100:00100000:1.0:1788941196.755908:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:1.0:1788941196.755919:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+12:18121:x1875840075984768:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.756090:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+12:18121:x1875840075984768:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 174us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941196.756100:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:3.0:1788941196.781151:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941196.781477:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075984896 00000100:00100000:2.0:1788941196.781490:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075984896 00000100:00100000:2.0:1788941196.781564:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 165 00000100:00100000:2.0:1788941196.781576:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+12:18121:x1875840075984896:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941196.781595:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941196.781617:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cac7ec5a00/0x24b6539075b3f1a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x69d7c94080151ae6 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.781647:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cac7ec5a00/0x24b6539075b3f1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ae6 expref: 13 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.781671:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cac7ec5a00/0x24b6539075b3f1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ae6 expref: 13 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941196.781680:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec5a00, rc 0) 00000100:00100000:2.0:1788941196.781745:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+13:18121:x1875840075984896:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 170us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941196.781752:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 165 00000100:00100000:0.0:1788941196.789487:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941196.789589:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075985024 00000100:00100000:3.0:1788941196.789601:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075985024 00000100:00100000:3.0:1788941196.789673:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:3.0:1788941196.789685:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+13:18121:x1875840075985024:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788941196.789911:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+13:18121:x1875840075985024:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 227us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941196.789920:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:0.0:1788941196.804464:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941196.805511:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075985152 00000100:00100000:1.0:1788941196.805526:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075985152 00000100:00100000:1.0:1788941196.805603:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:1.0:1788941196.805618:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+13:18121:x1875840075985152:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941196.805876:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a79c71a8-4021-46b6-985c-4d69e840c681+13:18121:x1875840075985152:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 261us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941196.805892:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 167 00010000:00010000:2.0:1788941197.128936:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941197.736575:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941197.736916:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075985280 00000100:00100000:3.0:1788941197.736927:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075985280 00000100:00100000:3.0:1788941197.737020:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:3.0:1788941197.737031:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:18744:x1875840075985280:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788941197.737074:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941197.737111:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f1a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151aed expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788941197.737629:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788941197.737718:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.737750:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.737764:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.737779:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.737787:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.737795:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.739117:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40200/0x24b6539075b3f1bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.739133:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40200/0x24b6539075b3f1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.739260:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40200/0x24b6539075b3f1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941197.739298:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788941197.739302:0:22698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788941197.739341:0:22698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40200/0x24b6539075b3f1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.739353:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.739371:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.739379:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.739384:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41600 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941197.739388:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.739396:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741528:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbcb9c4400) 00010000:00010000:3.0:1788941197.741550:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941197.741562:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741572:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741594:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741600:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741776:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741785:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41000 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941197.741803:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741811:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741823:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99cac6855400) 00010000:00010000:3.0:1788941197.741826:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941197.741829:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.741874:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.742757:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f1a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aed expref: 8 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.742776:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40200/0x24b6539075b3f1bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151aed expref: 7 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.742784:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cac6855c00) 00010000:00010000:3.0:1788941197.742787:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788941197.742790:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f40200, rc 0) 00000100:00100000:3.0:1788941197.750999:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18744:x1875840075985280:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 5864us (6328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941197.751082:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:0.0:1788941197.767950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941197.768167:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075985408 00000100:00100000:1.0:1788941197.768178:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075985408 00000100:00100000:1.0:1788941197.768248:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788941197.768259:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18744:x1875840075985408:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788941197.768362:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18744:x1875840075985408:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 Request processed in 105us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941197.768370:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:0.0:1788941197.771092:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941197.771197:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075985664 00000100:00100000:2.0:1788941197.771207:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075985664 00000100:00100000:2.0:1788941197.771262:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788941197.771271:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18744:x1875840075985664:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788941197.771289:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941197.771310:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f1c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151af4 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771383:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771399:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771421:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771436:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771443:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771450:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771680:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4200/0x24b6539075b3f1d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771690:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4200/0x24b6539075b3f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771755:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4200/0x24b6539075b3f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941197.771766:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788941197.771972:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771981:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771988:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.771995:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5400 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941197.771999:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772006:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772018:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cac6855c00) 00010000:00010000:2.0:1788941197.772021:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941197.772026:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772032:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f1ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772045:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772051:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772062:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772067:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4e00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941197.772070:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772076:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772084:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99cbcb9c4100) 00010000:00010000:2.0:1788941197.772087:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941197.772090:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.772096:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f1d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.773857:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f1c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151af4 expref: 10 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.773879:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4200/0x24b6539075b3f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151af4 expref: 9 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941197.773888:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cbcb9c4000) 00010000:00010000:2.0:1788941197.773890:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941197.773893:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4200, rc 0) 00000100:00100000:2.0:1788941197.774477:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:18744:x1875840075985664:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3204us (3393us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788941197.774530:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:3.0:1788941197.813828:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941197.814236:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075985792 00000100:00100000:0.0:1788941197.814248:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075985792 00000100:00100000:0.0:1788941197.814313:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788941197.814323:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:18744:x1875840075985792:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788941197.814450:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:18744:x1875840075985792:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 128us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941197.814458:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788941197.819530:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941197.831997:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075985920 00000100:00100000:2.0:1788941197.832013:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075985920 00000100:00100000:2.0:1788941197.832128:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:2.0:1788941197.832140:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:18744:x1875840075985920:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788941197.832545:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788941197.835308:0:22696:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3122us 00000100:00100000:1.0:1788941197.889855:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941197.889941:0:22697:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788941197.889961:0:22697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788941197.890298:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075986048 00000100:00100000:1.0:1788941197.890308:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075986048 00000100:00100000:3.0:1788941197.890536:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:3.0:1788941197.890548:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:18750:x1875840075986048:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788941197.890566:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941197.890585:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f1e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151afb expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890657:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890672:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890684:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890711:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890719:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890726:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890772:0:25742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890779:0:25742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890786:0:25742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890799:0:25742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41000 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941197.890805:0:25742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890813:0:25742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890828:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbcb9c4400) 00010000:00010000:3.0:1788941197.890831:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941197.890867:0:25742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890874:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f1ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890885:0:25742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890890:0:25742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890896:0:25742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890900:0:25742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41600 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941197.890903:0:25742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890908:0:25742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890927:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cac6855400) 00010000:00010000:3.0:1788941197.890929:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941197.890933:0:25742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890937:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f1f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890968:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f1e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151afb expref: 10 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890978:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbcb9c4400) 00010000:00010000:3.0:1788941197.890981:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941197.890984:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f1e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151afb expref: 10 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.890993:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f41800, rc 0) 00000100:00100000:3.0:1788941197.891069:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:18750:x1875840075986048:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 523us (1245us total) trans 0 rc 301/301 00000100:00100000:3.0:1788941197.891077:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:3.0:1788941197.892468:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:18744:x1875840075985920:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 60326us (72942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941197.892480:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:1.0:1788941197.911056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941197.911167:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075986176 00000100:00100000:2.0:1788941197.911177:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075986176 00000100:00100000:2.0:1788941197.911239:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788941197.911249:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:18750:x1875840075986176:12345-192.168.201.42@tcp:700:lfs.0 00000100:00100000:2.0:1788941197.911337:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:18750:x1875840075986176:12345-192.168.201.42@tcp:700:lfs.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941197.911344:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788941197.914007:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941197.914081:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075986432 00000100:00100000:1.0:1788941197.914090:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075986432 00000100:00100000:1.0:1788941197.914141:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:1.0:1788941197.914150:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:18750:x1875840075986432:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:1.0:1788941197.914216:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941197.914244:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f114 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151a68 expref: 9 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941197.914262:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbcb9c4400) 00010000:00010000:1.0:1788941197.914267:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788941197.914331:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941197.914356:0:22697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 5 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941197.914366:0:22697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941197.914397:0:22697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 5 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941197.914410:0:22697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 5 pid: 22696 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941197.914425:0:22697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac8688a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22697:1875840102319744:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788941197.914503:0:22697:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbf903e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788941197.916806:0:22697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac8688a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22697:1875840102319744:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788941197.916863:0:22697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941197.918340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941197.918590:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075986560 00000100:00100000:3.0:1788941197.918609:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075986560 00010000:00010000:3.0:1788941197.918671:0:22682:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 6 pid: 22696 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941197.918730:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788941197.918740:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2403:x1875840075986560:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788941197.918754:0:22682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941197.918761:0:22682:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 6 pid: 22696 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.918772:0:22682:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 6 pid: 22696 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.918797:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f153 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ad8 expref: 6 pid: 22696 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.918814:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbcb9c4400) 00010000:00010000:3.0:1788941197.918819:0:22682:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.918829:0:22682:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.918872:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941197.918914:0:22682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941197.918964:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2403:x1875840075986560:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 225us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941197.918971:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00010000:00010000:0.0:1788941197.919200:0:22697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.919209:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.919233:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.919242:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.919251:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788941197.919964:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788941197.920983:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.920998:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921019:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788941197.921037:0:22697:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086020c9b reply state 0000000066c48c02 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921048:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921055:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:0.0:1788941197.921058:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788941197.921062:0:22697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788941197.921067:0:22697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788941197.921075:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921082:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921088:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921095:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80d000 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:0.0:1788941197.921099:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921107:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921117:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbcb9c4400) 00010000:00010000:0.0:1788941197.921119:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941197.921129:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921147:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d000/0x24b6539075b3f1fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788941197.921166:0:22697:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086020c9b reply state 0000000066c48c02 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921176:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941197.921183:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cac6a5df00) 00010000:00010000:0.0:1788941197.921489:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788941197.921492:0:22697:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788941197.922860:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+10:18750:x1875840075986432:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 8679us (8829us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788941197.922871:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:2.0:1788941198.142927:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941198.143155:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075986688 00000100:00100000:3.0:1788941198.143180:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075986688 00000100:00100000:3.0:1788941198.143254:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788941198.143265:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+10:18758:x1875840075986688:12345-192.168.201.42@tcp:101:lctl.0 00010000:00010000:3.0:1788941198.143289:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941198.143313:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f210 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b02 expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.143383:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f217 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.143398:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.143410:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941198.143452:0:25742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788941198.143456:0:25742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788941198.143495:0:25742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.143520:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f210 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b02 expref: 12 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.143551:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41800/0x24b6539075b3f217 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b02 expref: 11 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.143559:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:3.0:1788941198.143562:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788941198.143566:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7f41800, rc 0) 00000100:00100000:3.0:1788941198.143646:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+11:18758:x1875840075986688:12345-192.168.201.42@tcp:101:lctl.0 Request processed in 382us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941198.143653:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00010000:00010000:2.0:1788941198.152311:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941198.187979:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.188086:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075986816 00000100:00100000:0.0:1788941198.188097:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075986816 00000100:00100000:0.0:1788941198.188169:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788941198.188180:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:18759:x1875840075986816:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788941198.188200:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941198.188224:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f21e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b09 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.188304:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ae00/0x24b6539075b3f225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.188318:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ae00/0x24b6539075b3f225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.188330:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ae00/0x24b6539075b3f225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941198.188390:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788941198.188394:0:22698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941198.188414:0:22698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ae00/0x24b6539075b3f225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.188439:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f21e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b09 expref: 7 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.188459:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ae00/0x24b6539075b3f225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b09 expref: 6 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.188468:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:0.0:1788941198.188471:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788941198.188475:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09ae00, rc 0) 00000100:00100000:0.0:1788941198.188552:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18759:x1875840075986816:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 374us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941198.188560:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788941198.200351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941198.200868:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075986944 00000100:00100000:3.0:1788941198.200879:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075986944 00000100:00100000:3.0:1788941198.200932:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788941198.200942:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac8688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:18759:x1875840075986944:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788941198.200962:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941198.200984:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f22c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b10 expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201045:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201058:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201068:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201099:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201106:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201112:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201222:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030a00/0x24b6539075b3f241 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201256:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030a00/0x24b6539075b3f241 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201263:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030a00/0x24b6539075b3f241 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941198.201305:0:25742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788941198.201327:0:25742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788941198.201351:0:25742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030a00/0x24b6539075b3f241 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201364:0:25742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201371:0:25742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201378:0:25742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201384:0:25742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f41000 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941198.201388:0:25742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201395:0:25742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201407:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:3.0:1788941198.201409:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941198.201414:0:25742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201441:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41000/0x24b6539075b3f233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201454:0:25742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201459:0:25742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201464:0:25742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201469:0:25742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7f40a00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941198.201472:0:25742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201478:0:25742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201485:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cac6a5df00) 00010000:00010000:3.0:1788941198.201488:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941198.201491:0:25742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201497:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f40a00/0x24b6539075b3f23a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201645:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7f41600/0x24b6539075b3f22c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b10 expref: 8 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201672:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030a00/0x24b6539075b3f241 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b10 expref: 7 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.201680:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:3.0:1788941198.201683:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788941198.201685:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc0030a00, rc 0) 00000100:00100000:3.0:1788941198.203047:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac8688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+7:18759:x1875840075986944:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 2101us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941198.203058:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788941198.229381:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.230008:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075987072 00000100:00100000:0.0:1788941198.230018:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075987072 00000100:00100000:0.0:1788941198.230093:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788941198.230105:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac868b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:18759:x1875840075987072:12345-192.168.201.42@tcp:900:lfs.0 00000100:00100000:0.0:1788941198.230199:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac868b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:18759:x1875840075987072:12345-192.168.201.42@tcp:900:lfs.0 Request processed in 97us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941198.230207:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00080000:1.0:1788941198.230658:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788941198.238211:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.238376:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075987328 00000100:00100000:0.0:1788941198.238386:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075987328 00000100:00100000:0.0:1788941198.238449:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788941198.238473:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfea7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+7:18759:x1875840075987328:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788941198.238495:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941198.238515:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f248 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b17 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941198.238622:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788941198.238730:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f248 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b17 expref: 9 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.238971:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:0.0:1788941198.238975:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788941198.238982:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f248 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b17 expref: 9 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.238998:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfc09ac00, rc 0) 00000100:00100000:0.0:1788941198.239097:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfea7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+8:18759:x1875840075987328:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 625us (895us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788941198.239104:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788941198.268588:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.268704:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075987584 00000100:00100000:0.0:1788941198.268715:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075987584 00000100:00100000:0.0:1788941198.268780:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:0.0:1788941198.268792:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+8:18759:x1875840075987584:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:0.0:1788941198.268911:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941198.268942:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030a00/0x24b6539075b3f241 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b10 expref: 8 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.268966:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:0.0:1788941198.268985:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941198.269007:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.269022:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.269033:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788941198.269599:0:22696:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096c42a5d reply state 000000008816f0fb transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.269612:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.269619:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:0.0:1788941198.269622:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788941198.269624:0:22696:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788941198.269641:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788941198.269712:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+9:18759:x1875840075987584:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 923us (1136us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788941198.269720:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788941198.276222:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.276360:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075987840 00000100:00100000:0.0:1788941198.276370:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075987840 00000100:00100000:0.0:1788941198.276425:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:0.0:1788941198.276436:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+9:18759:x1875840075987840:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788941198.276685:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+10:18759:x1875840075987840:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 250us (472us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788941198.276693:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:1.0:1788941198.288029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941198.288722:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075988096 00000100:00100000:2.0:1788941198.288732:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075988096 00000100:00100000:2.0:1788941198.288807:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:2.0:1788941198.288818:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+10:18759:x1875840075988096:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788941198.288872:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941198.288894:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f25d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b1e expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.288987:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289002:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289013:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289024:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289031:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289037:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941198.289155:0:22697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788941198.289675:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289684:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289691:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289697:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5400 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941198.289702:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289720:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289733:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:2.0:1788941198.289736:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941198.289741:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289748:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f264 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289762:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289768:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289774:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289779:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4c00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941198.289782:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289788:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289796:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cac6a5df00) 00010000:00010000:2.0:1788941198.289798:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941198.289801:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289820:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f26b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289904:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f25d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b1e expref: 12 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289916:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:2.0:1788941198.289919:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788941198.289922:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f25d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b1e expref: 12 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.289932:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4e00, rc 0) 00000100:00100000:2.0:1788941198.290009:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+11:18759:x1875840075988096:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1192us (1988us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788941198.290017:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788941198.293213:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.293828:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075988224 00000100:00100000:0.0:1788941198.293886:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075988224 00000100:00100000:0.0:1788941198.293962:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:0.0:1788941198.293974:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+11:18759:x1875840075988224:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788941198.293999:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941198.294022:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b400/0x24b6539075b3f279 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b25 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.294181:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.294197:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.294210:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941198.294238:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788941198.294241:0:22696:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941198.294262:0:22696:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.294291:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b400/0x24b6539075b3f279 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 13 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.294313:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.294321:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:0.0:1788941198.294324:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788941198.294334:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7db1a00, rc 0) 00000100:00100000:0.0:1788941198.294411:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+12:18759:x1875840075988224:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 428us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941198.294420:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:3.0:1788941198.321386:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.321698:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075988352 00000100:00100000:0.0:1788941198.321708:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075988352 00000100:00100000:0.0:1788941198.321769:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:0.0:1788941198.321779:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+12:18759:x1875840075988352:12345-192.168.201.42@tcp:37:lfs.0 00000100:00100000:0.0:1788941198.328105:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+12:18759:x1875840075988352:12345-192.168.201.42@tcp:37:lfs.0 Request processed in 6316us (6731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941198.328119:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788941198.339039:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941198.339147:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075988608 00000100:00100000:1.0:1788941198.339157:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075988608 00000100:00100000:1.0:1788941198.339215:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788941198.339226:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7483450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+12:18759:x1875840075988608:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788941198.339777:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7483450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+13:18759:x1875840075988608:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 550us (746us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788941198.339785:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000040:00080000:0.0:1788941198.405302:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788941198.476056:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941198.476210:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075988736 00000100:00100000:2.0:1788941198.476222:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075988736 00000100:00100000:2.0:1788941198.476292:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:2.0:1788941198.476304:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+11:18765:x1875840075988736:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788941198.476326:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941198.476350:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b2c expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476450:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476469:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476502:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476518:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476527:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476535:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476621:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f29c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476639:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f29c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476646:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f29c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941198.476681:0:22697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788941198.476685:0:22697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788941198.476724:0:22697:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f29c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476738:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476745:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476765:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476771:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5400 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941198.476776:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476785:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476799:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:2.0:1788941198.476802:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941198.476809:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476816:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f28e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476830:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476915:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476921:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476926:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4400 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941198.476929:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476945:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476954:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cac6a5df00) 00010000:00010000:2.0:1788941198.476956:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941198.476960:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476966:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.476994:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b2c expref: 13 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.477008:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4e00/0x24b6539075b3f29c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b2c expref: 12 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.477015:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:2.0:1788941198.477018:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788941198.477020:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4e00, rc 0) 00000100:00100000:2.0:1788941198.477091:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+12:18765:x1875840075988736:12345-192.168.201.42@tcp:101:bash.0 Request processed in 789us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941198.477098:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:2.0:1788941198.486359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.486546:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075988864 00000100:00100000:0.0:1788941198.486558:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075988864 00000100:00100000:0.0:1788941198.486644:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788941198.486655:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:18765:x1875840075988864:12345-192.168.201.42@tcp:900:bash.0 00000100:00100000:0.0:1788941198.486744:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:18765:x1875840075988864:12345-192.168.201.42@tcp:900:bash.0 Request processed in 91us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941198.486751:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788941198.491193:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941198.491311:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075989120 00000100:00100000:1.0:1788941198.491321:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075989120 00000100:00100000:1.0:1788941198.491386:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788941198.491396:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+12:18765:x1875840075989120:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788941198.491417:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941198.491437:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f2a3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b33 expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941198.491562:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941198.491588:0:25742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941198.491597:0:25742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941198.491641:0:25742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941198.491654:0:25742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 12 pid: 22696 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941198.491682:0:25742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25742:1875840102319872:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788941198.491770:0:25742:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc679b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788941198.500775:0:25742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25742:1875840102319872:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788941198.500806:0:25742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941198.512951:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941198.513208:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075989248 00000100:00100000:2.0:1788941198.513219:0:23451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075989248 00010000:00010000:2.0:1788941198.513264:0:23451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 13 pid: 22696 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941198.513329:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788941198.513339:0:23451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+13:2404:x1875840075989248:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941198.513355:0:23451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941198.513364:0:23451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 13 pid: 22696 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.513377:0:23451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 13 pid: 22696 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.513400:0:23451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1a00/0x24b6539075b3f280 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b25 expref: 13 pid: 22696 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.513418:0:23451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:2.0:1788941198.513423:0:23451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.513433:0:23451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.513442:0:23451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941198.513469:0:23451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941198.513516:0:23451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+12:2404:x1875840075989248:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 178us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941198.513533:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00010000:00010000:3.0:1788941198.515173:0:25742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.515187:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.515271:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.515283:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.515308:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516135:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516147:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516155:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941198.516166:0:25742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788941198.516192:0:25742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516199:0:25742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516206:0:25742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516213:0:25742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80d800 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941198.516217:0:25742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516225:0:25742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516235:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:3.0:1788941198.516238:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941198.516252:0:25742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516258:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f2aa lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788941198.516272:0:25742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2f8b04d reply state 00000000c4f66c71 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516282:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516289:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99cac6855400) 00010000:00010000:3.0:1788941198.516291:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788941198.516294:0:25742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788941198.516328:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f2a3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 15 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516344:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 14 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941198.516351:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941198.516354:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788941198.516356:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc0031c00, rc 0) 00000100:00100000:3.0:1788941198.522160:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+15:18765:x1875840075989120:12345-192.168.201.42@tcp:101:bash.0 Request processed in 30751us (30963us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788941198.522183:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:3.0:1788941198.544385:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.544657:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075989376 00000100:00100000:0.0:1788941198.544670:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075989376 00000100:00100000:0.0:1788941198.544743:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:0.0:1788941198.544755:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+15:18765:x1875840075989376:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788941198.544786:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941198.544813:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1600/0x24b6539075b3f2c6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b3a expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.544960:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f2cd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.544974:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f2cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.544986:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f2cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941198.545045:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788941198.545049:0:22698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941198.545071:0:22698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f2cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.545082:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f2cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.545119:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1600/0x24b6539075b3f2c6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b3a expref: 17 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.545138:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f2cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b3a expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.545146:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941198.545149:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788941198.545152:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7db0c00, rc 0) 00000100:00100000:0.0:1788941198.545208:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+16:18765:x1875840075989376:12345-192.168.201.42@tcp:101:bash.0 Request processed in 455us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941198.545216:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:1.0:1788941198.552202:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.552280:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075989632 00000100:00100000:0.0:1788941198.552291:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075989632 00000100:00100000:0.0:1788941198.552349:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:0.0:1788941198.552359:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+16:18765:x1875840075989632:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:0.0:1788941198.552673:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+17:18765:x1875840075989632:12345-192.168.201.42@tcp:35:bash.0 Request processed in 315us (481us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788941198.552681:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000040:00080000:0.0:1788941198.724878:0:23449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788941198.739753:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.741666:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075989888 00000100:00100000:0.0:1788941198.741681:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075989888 00000100:00100000:0.0:1788941198.741755:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:0.0:1788941198.741766:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+17:18775:x1875840075989888:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788941198.741794:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941198.741816:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1600/0x24b6539075b3f2d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b41 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941198.741951:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788941198.742049:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1600/0x24b6539075b3f2d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b41 expref: 19 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.742063:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:0.0:1788941198.742066:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788941198.742072:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1600/0x24b6539075b3f2d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b41 expref: 19 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.742086:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7db1600, rc 0) 00000100:00100000:0.0:1788941198.742152:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+18:18775:x1875840075989888:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 389us (2409us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788941198.742173:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:3.0:1788941198.747172:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.749002:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075990144 00000100:00100000:0.0:1788941198.749017:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075990144 00000100:00100000:0.0:1788941198.749084:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788941198.749096:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+18:18775:x1875840075990144:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788941198.749358:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+19:18775:x1875840075990144:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 264us (2195us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788941198.749366:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788941198.852362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.852527:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075990400 00000100:00100000:0.0:1788941198.852538:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075990400 00000100:00100000:0.0:1788941198.852600:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788941198.852610:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+19:18778:x1875840075990400:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788941198.852645:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941198.852671:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1600/0x24b6539075b3f2e2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b48 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.852826:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1800/0x24b6539075b3f2e9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.852886:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1800/0x24b6539075b3f2e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.852901:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1800/0x24b6539075b3f2e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941198.852915:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788941198.853027:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1600/0x24b6539075b3f2e2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b48 expref: 22 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.853054:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1800/0x24b6539075b3f2e9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b48 expref: 21 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.853062:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941198.853065:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788941198.853069:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7db1800, rc 0) 00000100:00100000:0.0:1788941198.853134:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+21:18778:x1875840075990400:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 524us (783us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788941198.853140:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:3.0:1788941198.857272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941198.857328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941198.857430:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075990656 00000100:00100000:1.0:1788941198.857441:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075990656 00000100:00100000:1.0:1788941198.857520:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788941198.857532:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+21:2405:x1875840075990656:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941198.857551:0:22682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941198.857582:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1800/0x24b6539075b3f2e9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b48 expref: 21 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941198.857604:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941198.857610:0:22682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941198.857680:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+20:2405:x1875840075990656:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 150us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941198.857687:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788941198.857813:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075990528 00000100:00100000:0.0:1788941198.857819:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075990528 00000100:00100000:0.0:1788941198.857896:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:0.0:1788941198.857904:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+20:18778:x1875840075990528:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:0.0:1788941198.857959:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.857973:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.857983:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.858018:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.858025:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.858043:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.858049:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db1400 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:0.0:1788941198.858052:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.858060:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.858069:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941198.858072:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788941198.858075:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941198.858080:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1400/0x24b6539075b3f2f7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941198.858120:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+20:18778:x1875840075990528:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 217us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941198.858127:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:3.0:1788941198.875663:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941198.875760:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075990912 00000100:00100000:0.0:1788941198.875770:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075990912 00000100:00100000:0.0:1788941198.875872:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788941198.875883:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+20:18778:x1875840075990912:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788941198.876144:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+21:18778:x1875840075990912:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 262us (490us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788941198.876153:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00010000:00010000:2.0:1788941199.173866:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941199.239071:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941199.239096:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102320000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788941199.239164:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941199.239314:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102320000 00000100:00100000:2.0:1788941199.239324:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102320000 00000100:00100000:2.0:1788941199.239386:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788941199.239398:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102320000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788941199.239439:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788941199.239486:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102320000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941199.239493:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788941199.239557:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788941199.239602:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102320000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788941199.245240:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102320256:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245310:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245357:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102320768:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245383:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245399:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875840102321280:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245427:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245451:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788941199.245457:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102320128:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245487:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245511:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102320640:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245532:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245603:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875840102321152:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245638:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245688:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245705:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102321024:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245739:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245754:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875840102321536:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245775:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245787:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788941199.245792:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102320384:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245863:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245880:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245902:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245928:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875840102321408:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.245948:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941199.245969:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102320256 00000100:00100000:0.0:1788941199.245976:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102320256 00000100:00100000:0.0:1788941199.246019:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102320640 00000100:00100000:0.0:1788941199.246022:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102320640 00000100:00100000:0.0:1788941199.246038:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788941199.246058:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102320256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246111:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102320256:12345-0@lo:400:kworker.0 Request processed in 65us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246118:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788941199.246135:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788941199.246141:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102320640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246167:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102320640:12345-0@lo:400:kworker.0 Request processed in 27us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246173:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788941199.246190:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102320768 00000100:00100000:0.0:1788941199.246193:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102320768 00000100:00100000:0.0:1788941199.246223:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102320384 00000100:00100000:0.0:1788941199.246226:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102320384 00000100:00100000:0.0:1788941199.246236:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102320896 00000100:00100000:0.0:1788941199.246239:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102320896 00000100:00100000:0.0:1788941199.246251:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788941199.246256:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102320768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246286:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102320768:12345-0@lo:400:kworker.0 Request processed in 29us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246292:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788941199.246303:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788941199.246316:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102320384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246348:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875840102320384:12345-0@lo:400:kworker.0 Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246354:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788941199.246365:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941199.246370:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102320896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246395:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102320896:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246401:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941199.246436:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102320384:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246446:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246478:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102320640:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246487:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102320256:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246495:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102320768:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246517:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102321280 00000100:00100000:0.0:1788941199.246534:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102321280 00000100:00100000:0.0:1788941199.246556:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102321152 00000100:00100000:0.0:1788941199.246559:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102321152 00000100:00100000:0.0:1788941199.246571:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102320512 00000100:00100000:0.0:1788941199.246573:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102320512 00000100:00100000:0.0:1788941199.246583:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102321024 00000100:00100000:0.0:1788941199.246586:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102321024 00000100:00100000:0.0:1788941199.246595:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102321536 00000100:00100000:0.0:1788941199.246598:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102321536 00000100:00100000:0.0:1788941199.246608:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102321408 00000100:00100000:0.0:1788941199.246619:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102321408 00000100:00100000:0.0:1788941199.246644:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788941199.246650:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875840102321280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246685:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875840102321280:12345-0@lo:400:kworker.0 Request processed in 35us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246691:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788941199.246701:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788941199.246706:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875840102321152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246744:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875840102321152:12345-0@lo:400:kworker.0 Request processed in 37us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246750:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788941199.246762:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788941199.246768:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102320512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246797:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102320512:12345-0@lo:400:kworker.0 Request processed in 30us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246803:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788941199.246825:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246871:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875840102321152:0@lo:400:kworker.0 00010000:00080000:0.0:1788941199.246883:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cacb71f100 x1875840102321280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941199.246894:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875840102321280:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246913:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788941199.246919:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102321024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.246953:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102321024:12345-0@lo:400:kworker.0 Request processed in 34us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.246967:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788941199.246979:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788941199.246985:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875840102321536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.247012:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875840102321536:12345-0@lo:400:kworker.0 Request processed in 27us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.247018:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788941199.247028:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788941199.247033:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875840102321408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.247058:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875840102321408:12345-0@lo:400:kworker.0 Request processed in 25us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941199.247064:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788941199.247087:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875840102321408:0@lo:400:kworker.0 00000100:00100000:0.0:1788941199.247096:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102321024:0@lo:400:kworker.0 00010000:00080000:0.0:1788941199.247105:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cacb71f800 x1875840102321536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941199.247114:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875840102321536:0@lo:400:kworker.0 00000100:00080000:1.0:1788941199.247381:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788941199.247386:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788941199.247389:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788941199.247391:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941199.247462:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102320128 00000100:00100000:2.0:1788941199.247467:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102320128 00000100:00100000:2.0:1788941199.247505:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788941199.247512:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac16fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3652:x1875840102320128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941199.247545:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac16fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3652:x1875840102320128:12345-0@lo:400:kworker.0 Request processed in 35us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941199.247552:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788941199.247734:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102321664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788941199.247768:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941199.248278:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102321664 00000100:00100000:2.0:1788941199.248284:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102321664 00000100:00100000:2.0:1788941199.248320:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788941199.248327:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102321664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788941199.248341:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788941199.248389:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102321664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941199.248396:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788941199.248473:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102321664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788941199.248654:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3652:1875840102320128:0@lo:400:kworker.0 00000100:00100000:3.0:1788941199.307529:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307652:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307681:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307710:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307752:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307777:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307796:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.307909:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075991040 00000100:00100000:3.0:1788941199.307922:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075991040 00000100:00100000:3.0:1788941199.307977:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:3.0:1788941199.307987:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+13:2404:x1875840075991040:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941199.308075:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a79c71a8-4021-46b6-985c-4d69e840c681+13:2404:x1875840075991040:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941199.308085:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:3.0:1788941199.308123:0:25391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075991424 00000100:00100000:3.0:1788941199.308128:0:25391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075991424 00000100:00080000:1.0:1788941199.308234:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941199.308249:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075991936 00000100:00100000:1.0:1788941199.308253:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075991936 00000100:00100000:1.0:1788941199.308284:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075991552 00000100:00100000:1.0:1788941199.308287:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075991552 00000100:00100000:1.0:1788941199.308298:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075992064 00000100:00100000:1.0:1788941199.308300:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075992064 00000100:00100000:1.0:1788941199.308313:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:1.0:1788941199.308320:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075991936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941199.308348:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075991936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.308354:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:1.0:1788941199.308366:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788941199.308372:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075991552:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941199.308394:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075991552:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.308400:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788941199.308411:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:1.0:1788941199.308416:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075992064:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941199.308438:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075992064:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.308455:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00080000:1.0:1788941199.308469:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788941199.308472:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941199.308481:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075991168 00000100:00100000:1.0:1788941199.308484:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075991168 00000100:00080000:1.0:1788941199.308499:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788941199.308517:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075991680 00000100:00100000:1.0:1788941199.308520:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075991680 00000100:00080000:1.0:1788941199.308531:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788941199.308543:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075991296 00000100:00100000:1.0:1788941199.308546:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075991296 00000100:00080000:1.0:1788941199.308558:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788941199.308569:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075991808 00000100:00100000:1.0:1788941199.308572:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075991808 00000100:00100000:1.0:1788941199.308586:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:1.0:1788941199.308592:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac86e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+21:2404:x1875840075991168:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941199.308639:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac86e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+21:2404:x1875840075991168:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 47us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.308646:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:1.0:1788941199.308659:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:1.0:1788941199.308665:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+12:2404:x1875840075991680:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941199.308686:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+12:2404:x1875840075991680:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.308691:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:1.0:1788941199.308701:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788941199.308706:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075991296:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941199.308737:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075991296:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.308744:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788941199.308756:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788941199.308762:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075991808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788941199.308785:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2404:x1875840075991808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.308791:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:3.0:1788941199.309381:0:25391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788941199.309390:0:25391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075991424:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941199.309438:0:25391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2404:x1875840075991424:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 51us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941199.309451:0:25391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788941199.460680:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941199.460775:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075992320 00000100:00100000:1.0:1788941199.460784:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075992320 00000100:00100000:1.0:1788941199.460885:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788941199.461162:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe56e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+21:18809:x1875840075992320:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788941199.461186:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941199.461208:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80dc00/0x24b6539075b3f2fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b4f expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.461315:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c400/0x24b6539075b3f305 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.461329:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c400/0x24b6539075b3f305 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.461343:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c400/0x24b6539075b3f305 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941199.461354:0:25742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788941199.462453:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80dc00/0x24b6539075b3f2fe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b4f expref: 24 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.462488:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c400/0x24b6539075b3f305 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b4f expref: 23 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.462497:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941199.462500:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788941199.462504:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80c400, rc 0) 00000100:00100000:1.0:1788941199.462694:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe56e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+23:18809:x1875840075992320:12345-192.168.201.42@tcp:101:cat.0 Request processed in 1799us (2025us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788941199.462702:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788941199.478647:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941199.478730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941199.478807:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075992704 00000100:00100000:2.0:1788941199.478821:0:23451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075992704 00000100:00100000:2.0:1788941199.478918:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788941199.478928:0:23451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+23:2406:x1875840075992704:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941199.478980:0:23451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941199.479008:0:23451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c400/0x24b6539075b3f305 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b4f expref: 23 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941199.479027:0:23451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:2.0:1788941199.479032:0:23451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941199.479140:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075992576 00000100:00100000:1.0:1788941199.479154:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075992576 00000100:00100000:1.0:1788941199.479190:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:1.0:1788941199.479197:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+23:18809:x1875840075992576:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:2.0:1788941199.487359:0:23451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+24:2406:x1875840075992704:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 8418us (8614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941199.487375:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:1.0:1788941199.488717:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+23:18809:x1875840075992576:12345-192.168.201.42@tcp:35:cat.0 Request processed in 9513us (10073us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788941199.488730:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788941199.656971:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941199.657064:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075992960 00000100:00100000:0.0:1788941199.657077:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075992960 00000100:00100000:0.0:1788941199.657156:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:0.0:1788941199.657168:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+23:18815:x1875840075992960:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788941199.657203:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941199.657238:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f313 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b56 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.657420:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0600/0x24b6539075b3f31a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.657437:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0600/0x24b6539075b3f31a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.657449:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0600/0x24b6539075b3f31a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941199.657461:0:22697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788941199.660863:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f313 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b56 expref: 26 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.660906:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0600/0x24b6539075b3f31a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b56 expref: 25 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.660917:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941199.660920:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788941199.660924:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7db0600, rc 0) 00000100:00100000:0.0:1788941199.661003:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+25:18815:x1875840075992960:12345-192.168.201.42@tcp:101:dd.0 Request processed in 3836us (4042us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788941199.661011:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:0.0:1788941199.674361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941199.674784:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075993088 00000100:00100000:1.0:1788941199.674795:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075993088 00000100:00100000:1.0:1788941199.674908:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:1.0:1788941199.674920:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+25:2404:x1875840075993088:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941199.674958:0:22682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941199.674984:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0600/0x24b6539075b3f31a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b56 expref: 25 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.675003:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941199.675014:0:22682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941199.675068:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+24:2404:x1875840075993088:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 151us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.675076:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:2.0:1788941199.676577:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941199.677831:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075993216 00000100:00100000:1.0:1788941199.677855:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075993216 00000100:00100000:1.0:1788941199.677922:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:1.0:1788941199.677933:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+24:18815:x1875840075993216:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788941199.677955:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941199.677974:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80dc00/0x24b6539075b3f328 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b5d expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.678008:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.678021:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.678033:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.678490:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80dc00/0x24b6539075b3f328 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 26 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.678573:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 25 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941199.678582:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941199.678585:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788941199.678596:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80da00, rc 0) 00000100:00100000:1.0:1788941199.678669:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+25:18815:x1875840075993216:12345-192.168.201.42@tcp:101:dd.0 Request processed in 738us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941199.678677:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:2.0:1788941199.706005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941199.708037:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075993472 00000100:00100000:0.0:1788941199.708053:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075993472 00000100:00100000:0.0:1788941199.708134:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:0.0:1788941199.708146:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+25:18815:x1875840075993472:12345-192.168.201.42@tcp:36:dd.0 00010000:00010000:0.0:1788941199.708225:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941199.708252:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f2cd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b3a expref: 25 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.708272:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941199.708277:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941199.708441:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.708457:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.708468:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788941199.708686:0:22698:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788941199.708709:0:22698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000733b5641 reply state 000000001a701868 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.708720:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941199.708727:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941199.708729:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788941199.708732:0:22698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788941199.709001:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+27:18815:x1875840075993472:12345-192.168.201.42@tcp:36:dd.0 Request processed in 692us (2842us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788941199.709009:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000020:00080000:0.0:1788941199.709015:0:22698:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788941199.748984:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788941199.749012:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102321792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788941199.749080:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941199.749296:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102321792 00000100:00100000:2.0:1788941199.749306:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102321792 00000100:00100000:2.0:1788941199.749363:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788941199.749373:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102321792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788941199.749406:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941199.749462:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875840102321792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941199.749469:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788941199.753156:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875840102321792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788941199.943701:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941199.943813:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075993728 00000100:00100000:1.0:1788941199.943823:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075993728 00000100:00100000:1.0:1788941199.943920:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788941199.943931:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+27:18815:x1875840075993728:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:1.0:1788941199.944174:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+28:18815:x1875840075993728:12345-192.168.201.42@tcp:35:dd.0 Request processed in 245us (484us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788941199.944182:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00010000:00010000:2.0:1788941200.196113:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941200.284454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941200.284575:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075993856 00000100:00100000:0.0:1788941200.284600:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075993856 00000100:00100000:0.0:1788941200.284662:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:0.0:1788941200.284673:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+28:18829:x1875840075993856:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:0.0:1788941200.284699:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941200.284720:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f33d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b64 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.284797:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.284817:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.284829:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.284889:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.284898:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.284904:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.284974:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0000/0x24b6539075b3f352 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.284984:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0000/0x24b6539075b3f352 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285008:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0000/0x24b6539075b3f352 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941200.285052:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788941200.285056:0:22696:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941200.285091:0:22696:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0000/0x24b6539075b3f352 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285103:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0000/0x24b6539075b3f352 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285111:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285117:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285124:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285131:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db1e00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:0.0:1788941200.285135:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285143:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285154:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:0.0:1788941200.285158:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941200.285163:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285179:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f344 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285194:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285199:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285205:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285210:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db0800 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:0.0:1788941200.285214:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285220:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285228:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99cac6855400) 00010000:00010000:0.0:1788941200.285231:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941200.285234:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285239:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f34b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285266:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f33d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b64 expref: 30 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285292:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0000/0x24b6539075b3f352 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b64 expref: 29 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.285299:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941200.285302:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788941200.285304:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7db0000, rc 0) 00000100:00100000:0.0:1788941200.285369:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+29:18829:x1875840075993856:12345-192.168.201.42@tcp:101:stat.0 Request processed in 698us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941200.285381:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:2.0:1788941200.418230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941200.418334:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075994112 00000100:00100000:0.0:1788941200.418345:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075994112 00000100:00100000:0.0:1788941200.418401:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:0.0:1788941200.418410:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+29:18835:x1875840075994112:12345-192.168.201.42@tcp:36:truncate.0 00010000:00010000:0.0:1788941200.418458:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941200.418483:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0000/0x24b6539075b3f352 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b64 expref: 29 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.418511:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941200.418516:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941200.418707:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.418720:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.418728:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788941200.418781:0:22698:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1788941200.418803:0:22698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bed7d1ee reply state 000000006a4b81f2 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.418815:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.418821:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:0.0:1788941200.418823:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788941200.418826:0:22698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788941200.418982:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+31:18835:x1875840075994112:12345-192.168.201.42@tcp:36:truncate.0 Request processed in 573us (763us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788941200.418990:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000020:00080000:0.0:1788941200.418994:0:22698:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788941200.459083:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788941200.717104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941200.717201:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075994240 00000100:00100000:1.0:1788941200.717212:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075994240 00000100:00100000:1.0:1788941200.717281:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:1.0:1788941200.717292:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+31:18849:x1875840075994240:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:1.0:1788941200.717318:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941200.717340:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80de00/0x24b6539075b3f360 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b6b expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717412:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717427:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717439:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717470:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717478:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717498:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717598:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717608:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717615:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941200.717656:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788941200.717661:0:22696:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788941200.717682:0:22696:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717694:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717702:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717709:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717727:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717734:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80c600 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941200.717738:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717747:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717759:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:1.0:1788941200.717762:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941200.717767:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717774:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f367 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717788:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717794:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717800:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717805:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80d400 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941200.717808:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717825:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717888:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99cac6855400) 00010000:00010000:1.0:1788941200.717891:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941200.717895:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717900:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f36e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717929:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80de00/0x24b6539075b3f360 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 33 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717943:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 32 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941200.717950:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941200.717952:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788941200.717954:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80cc00, rc 0) 00000100:00100000:1.0:1788941200.718023:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+32:18849:x1875840075994240:12345-192.168.201.42@tcp:101:stat.0 Request processed in 731us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941200.718030:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:0.0:1788941200.772372:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788941200.772399:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102321920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941200.772469:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941200.772688:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102321920 00000100:00100000:3.0:1788941200.772699:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102321920 00000100:00100000:3.0:1788941200.772755:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788941200.772765:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102321920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788941200.772801:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788941200.772869:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102321920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941200.772876:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788941200.773097:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788941200.773108:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102322048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941200.773138:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941200.773165:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102322048 00000100:00100000:2.0:1788941200.773169:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102322048 00000100:00100000:2.0:1788941200.773194:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788941200.773218:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102322048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788941200.773236:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788941200.773269:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102322048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941200.773275:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788941200.773314:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102322048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788941200.773729:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941200.773740:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb7a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102322176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941200.773771:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941200.773819:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102321920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941200.773899:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102322176 00000100:00100000:3.0:1788941200.773905:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102322176 00000100:00100000:3.0:1788941200.773939:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788941200.773957:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102322176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788941200.773970:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788941200.774011:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102322176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941200.774017:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788941200.774206:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb7a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102322176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788941200.910064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941200.910178:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075994496 00000100:00100000:0.0:1788941200.910189:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075994496 00000100:00100000:0.0:1788941200.910317:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:0.0:1788941200.910342:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+32:18859:x1875840075994496:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788941200.910364:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941200.910387:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f37c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b72 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941200.910491:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788941200.910628:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f37c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b72 expref: 34 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.910645:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:0.0:1788941200.910648:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788941200.910653:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0800/0x24b6539075b3f37c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b72 expref: 34 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941200.910669:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7db0800, rc 0) 00000100:00100000:0.0:1788941200.910738:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+33:18859:x1875840075994496:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 397us (684us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1788941200.910745:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:0.0:1788941200.922488:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941200.923693:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075994752 00000100:00100000:1.0:1788941200.923705:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075994752 00000100:00100000:1.0:1788941200.923771:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788941200.923782:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe7483c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+33:18859:x1875840075994752:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788941200.924107:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe7483c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+34:18859:x1875840075994752:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 327us (1628us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788941200.924116:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788941201.080623:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.080732:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075995008 00000100:00100000:1.0:1788941201.080742:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075995008 00000100:00100000:1.0:1788941201.080829:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788941201.080884:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+34:18865:x1875840075995008:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788941201.080913:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941201.080933:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80de00/0x24b6539075b3f38a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b79 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.081047:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.081063:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 35 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.081071:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 35 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.081079:0:22696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.081127:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 35 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.081141:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 35 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.081200:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102322304:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788941201.081286:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 35 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.081294:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 35 pid: 25742 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.081302:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66db800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102322432:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788941201.081324:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc1254000 going to sleep for 11 seconds 00000100:00080000:2.0:1788941201.081866:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788941201.094624:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102322304:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788941201.094641:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66db800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102322432:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788941201.094667:0:22696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941201.103121:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.103245:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.103510:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075995136 00000100:00100000:1.0:1788941201.103522:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075995136 00010000:00010000:1.0:1788941201.103567:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 36 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.103605:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075995264 00000100:00100000:1.0:1788941201.103609:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075995264 00010000:00010000:1.0:1788941201.103620:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 37 pid: 25742 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.103647:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788941201.103664:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+37:2403:x1875840075995136:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941201.103677:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941201.103683:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 37 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103695:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 37 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103716:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f375 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b6b expref: 37 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103733:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941201.103738:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103747:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103754:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941201.103798:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+36:2403:x1875840075995136:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 136us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941201.103805:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788941201.103891:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:1.0:1788941201.103897:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+35:2403:x1875840075995264:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941201.103903:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941201.103907:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 35 pid: 25742 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103939:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 35 pid: 25742 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103950:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031c00/0x24b6539075b3f2b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b33 expref: 35 pid: 25742 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103959:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941201.103963:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103970:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.103977:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.104000:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941201.104018:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+34:2403:x1875840075995264:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 120us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941201.104024:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00010000:00010000:1.0:1788941201.104043:0:22696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.104050:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941201.104068:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788941201.104638:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80de00/0x24b6539075b3f38a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 35 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.104665:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 34 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.104672:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941201.104674:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788941201.104677:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80d400, rc 0) 00000100:00100000:1.0:1788941201.104716:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+34:18865:x1875840075995008:12345-192.168.201.42@tcp:101:bash.0 Request processed in 23837us (24104us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1788941201.104723:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:3.0:1788941201.108455:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.108598:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075995520 00000100:00100000:2.0:1788941201.108609:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075995520 00000100:00100000:2.0:1788941201.108669:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:2.0:1788941201.108678:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+34:18865:x1875840075995520:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:2.0:1788941201.108923:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.108940:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.108959:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788941201.108996:0:22697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1788941201.109013:0:22697:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001755d435 reply state 000000009637290d transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.109025:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.109032:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:2.0:1788941201.109035:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788941201.109050:0:22697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788941201.109136:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+37:18865:x1875840075995520:12345-192.168.201.42@tcp:36:bash.0 Request processed in 459us (690us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1788941201.109155:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000020:00080000:2.0:1788941201.109160:0:22697:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788941201.111916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.112146:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075995648 00000100:00100000:3.0:1788941201.112156:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075995648 00000100:00100000:3.0:1788941201.112215:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:3.0:1788941201.112224:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+37:18865:x1875840075995648:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788941201.112246:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941201.112264:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f3a6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b80 expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.112317:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f3a6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b80 expref: 38 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.112332:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f3a6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b80 expref: 38 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.112350:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941201.112353:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788941201.112356:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc0031a00, rc 0) 00000100:00100000:3.0:1788941201.112407:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18865:x1875840075995648:12345-192.168.201.42@tcp:101:bash.0 Request processed in 184us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.112414:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:3.0:1788941201.124976:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.125446:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075995776 00000100:00100000:2.0:1788941201.125457:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075995776 00000100:00100000:2.0:1788941201.125529:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:2.0:1788941201.125539:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18865:x1875840075995776:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788941201.125560:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941201.125590:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3ad lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b87 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.125680:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.125696:0:22697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 39 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.125706:0:22697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.125741:0:22697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 39 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.125754:0:22697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 39 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941201.125770:0:22697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb71ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22697:1875840102322560:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788941201.125932:0:22697:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc2acb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788941201.130686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.133036:0:22697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb71ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22697:1875840102322560:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788941201.133075:0:22697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.134880:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075995904 00000100:00100000:1.0:1788941201.134894:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075995904 00010000:00010000:1.0:1788941201.137164:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 40 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.137335:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:1.0:1788941201.137353:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+40:2403:x1875840075995904:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941201.137371:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941201.137378:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 40 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.137393:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 40 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.137416:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d400/0x24b6539075b3f391 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b79 expref: 40 pid: 22696 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.137455:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941201.137461:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.137471:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.138070:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.138279:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788941201.138406:0:22697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.138416:0:22697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941201.138488:0:22697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788941201.138493:0:22697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788941201.138512:0:22697:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.138546:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3ad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b87 expref: 40 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.138562:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b87 expref: 39 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.138570:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:2.0:1788941201.138573:0:22697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788941201.138575:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec5400, rc 0) 00000100:00100000:1.0:1788941201.138753:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+39:2403:x1875840075995904:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 1407us (8075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941201.138761:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788941201.148221:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18865:x1875840075995776:12345-192.168.201.42@tcp:101:bash.0 Request processed in 22668us (23239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941201.148234:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:0.0:1788941201.171718:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.177424:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075996160 00000100:00100000:2.0:1788941201.177459:0:23451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075996160 00000100:00100000:3.0:1788941201.178972:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788941201.178986:0:23451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18865:x1875840075996160:12345-192.168.201.42@tcp:103:bash.0 00010000:00010000:3.0:1788941201.179003:0:23451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788941201.179030:0:23451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f3a6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b80 expref: 38 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.179067:0:23451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3b4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b87 expref: 37 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.179078:0:23451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941201.179626:0:23451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941201.179691:0:23451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+36:18865:x1875840075996160:12345-192.168.201.42@tcp:103:bash.0 Request processed in 707us (7983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.179699:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788941201.184496:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.191039:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075996288 00000100:00100000:2.0:1788941201.191055:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075996288 00000100:00100000:3.0:1788941201.191208:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:3.0:1788941201.191219:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+36:18865:x1875840075996288:12345-192.168.201.42@tcp:58:bash.0 00010000:00010000:3.0:1788941201.191324:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.191343:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.191355:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788941201.194981:0:25742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941201.195012:0:25742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788941201.195290:0:25742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788941201.195437:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+36:18865:x1875840075996288:12345-192.168.201.42@tcp:58:bash.0 Request processed in 4214us (10954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.195450:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:0.0:1788941201.205393:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.205583:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075996416 00000100:00100000:2.0:1788941201.205594:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075996416 00000100:00100000:2.0:1788941201.205663:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:2.0:1788941201.205674:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+36:18865:x1875840075996416:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788941201.205695:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941201.205716:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b8e expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.205774:0:22698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.205785:0:22698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b8e expref: 37 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.205805:0:22698:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.205819:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b8e expref: 37 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.205867:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:2.0:1788941201.205870:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788941201.205875:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b8e expref: 37 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.205884:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7ec4400, rc 0) 00000100:00100000:2.0:1788941201.205961:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+37:18865:x1875840075996416:12345-192.168.201.42@tcp:101:bash.0 Request processed in 289us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941201.205969:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00010000:00010000:2.0:1788941201.221960:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788941201.476405:0:22731:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788941201.476417:0:22731:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788941201.476449:0:22731:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788941201.476458:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788941201.476656:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22731:1875840102322688:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788941201.476757:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb70b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788941201.488465:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.491442:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075996544 00000100:00100000:1.0:1788941201.491457:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075996544 00000100:00100000:1.0:1788941201.491543:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788941201.491554:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18866:x1875840075996544:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788941201.491595:0:22696:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788941201.491728:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18866:x1875840075996544:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 176us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941201.491736:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:3.0:1788941201.496629:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22731:1875840102322688:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788941201.514042:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.515486:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075996672 00000100:00100000:2.0:1788941201.515499:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075996672 00000100:00100000:2.0:1788941201.515567:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:2.0:1788941201.515587:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+37:18866:x1875840075996672:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788941201.515662:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515680:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515693:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515736:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515743:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515749:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515771:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515779:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515803:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941201.515884:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788941201.515888:0:22698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788941201.515900:0:22698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515910:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.515916:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519414:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519425:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5800 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941201.519430:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519440:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519457:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cbcb9c4000) 00010000:00010000:2.0:1788941201.519460:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941201.519465:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519472:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5800/0x24b6539075b3f3c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519516:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519523:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519529:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519534:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec5400 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941201.519537:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519542:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519550:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff99cbcb9c4100) 00010000:00010000:2.0:1788941201.519552:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941201.519555:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519560:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec5400/0x24b6539075b3f3d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519591:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519598:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519603:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519614:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfeb1fc00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:2.0:1788941201.519617:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519624:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519633:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:2.0:1788941201.519635:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941201.519638:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.519643:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfeb1fc00/0x24b6539075b3f3d7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941201.519754:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+37:18866:x1875840075996672:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 4164us (5717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941201.519765:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:2.0:1788941201.535935:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.536299:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075996928 00000100:00100000:1.0:1788941201.536310:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075996928 00000100:00100000:1.0:1788941201.536356:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:1.0:1788941201.536364:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+37:18866:x1875840075996928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788941201.536398:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941201.536416:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f3de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b95 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536538:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536553:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536565:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941201.536585:0:22696:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788941201.536661:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536669:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536676:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536682:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80c600 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941201.536686:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536694:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536706:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941201.536716:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788941201.536724:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536730:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3e5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536773:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f3de lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b95 expref: 39 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536786:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cbcb9c4000) 00010000:00010000:1.0:1788941201.536788:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788941201.536792:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f3de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b95 expref: 39 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.536800:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80cc00, rc 0) 00000100:00100000:1.0:1788941201.536918:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18866:x1875840075996928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 553us (990us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1788941201.536926:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:0.0:1788941201.546976:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.547210:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075997056 00000100:00100000:2.0:1788941201.547219:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075997056 00000100:00100000:2.0:1788941201.547289:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788941201.547299:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18866:x1875840075997056:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788941201.547341:0:22697:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788941201.547510:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18866:x1875840075997056:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 211us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941201.547518:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788941201.556477:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.556592:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075997312 00000100:00100000:1.0:1788941201.556604:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075997312 00000100:00100000:1.0:1788941201.556668:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788941201.556679:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+38:18866:x1875840075997312:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788941201.556701:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941201.556722:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f3f3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151b9c expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788941201.557451:0:22696:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:1.0:1788941201.557465:0:22696:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788941201.557488:0:22696:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1788941201.557654:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3fa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.557670:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.557682:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.557739:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f3f3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b9c expref: 41 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.557760:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3fa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b9c expref: 40 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.557769:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cbcd81c900) 00010000:00010000:1.0:1788941201.557772:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788941201.557776:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80c600, rc 0) 00000100:00100000:1.0:1788941201.557881:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+40:18866:x1875840075997312:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1204us (1418us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788941201.557891:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:2.0:1788941201.579242:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941201.579436:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075997568 00000100:00100000:0.0:1788941201.579446:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075997568 00000100:00100000:0.0:1788941201.579515:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:0.0:1788941201.579524:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+40:18866:x1875840075997568:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788941201.579586:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941201.579612:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c600/0x24b6539075b3f3fa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b9c expref: 40 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579630:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cbcd81c900) 00010000:00010000:0.0:1788941201.579641:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941201.579661:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579676:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579687:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579700:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579706:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579712:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579767:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579774:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579781:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579786:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db1c00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:0.0:1788941201.579791:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579798:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579805:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:0.0:1788941201.579808:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941201.579811:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579817:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1c00/0x24b6539075b3f408 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579826:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579831:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579890:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579902:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db1200 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:0.0:1788941201.579905:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579912:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579920:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xeab2ce1a (ffff99cac6a5d800) 00010000:00010000:0.0:1788941201.579922:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941201.579925:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.579931:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f40f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xeab2ce1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941201.580017:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+39:18866:x1875840075997568:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 492us (784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788941201.580025:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:0.0:1788941201.589444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.589737:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075997696 00000100:00100000:3.0:1788941201.589749:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075997696 00000100:00100000:3.0:1788941201.589816:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788941201.589829:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+39:18866:x1875840075997696:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788941201.589879:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941201.589905:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f416 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151ba3 expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.589943:0:25742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031800/0x24b6539075b3f41d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.589958:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031800/0x24b6539075b3f41d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.589970:0:25742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031800/0x24b6539075b3f41d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.590109:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f416 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ba3 expref: 41 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.590128:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031800/0x24b6539075b3f41d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151ba3 expref: 40 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.590488:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:3.0:1788941201.590491:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788941201.590495:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc0031800, rc 0) 00000100:00100000:3.0:1788941201.590563:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+40:18866:x1875840075997696:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 737us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.590593:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:1.0:1788941201.597287:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941201.597644:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075997952 00000100:00100000:0.0:1788941201.597655:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075997952 00000100:00100000:0.0:1788941201.597719:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:0.0:1788941201.597730:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+40:18866:x1875840075997952:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788941201.597882:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.597902:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.597928:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788941201.598122:0:22698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788941201.598134:0:22698:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 810265298562ns, next at 811265295904ns, rc = 0 00000004:00010000:0.0:1788941201.598184:0:22698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7bf168b reply state 0000000026aa0f85 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.598199:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.598207:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:0.0:1788941201.598210:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788941201.598214:0:22698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788941201.598370:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+42:18866:x1875840075997952:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 641us (1092us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1788941201.598378:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788941201.609923:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.610053:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075998080 00000100:00100000:3.0:1788941201.610063:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075998080 00000100:00100000:3.0:1788941201.610144:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:3.0:1788941201.610164:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+42:18866:x1875840075998080:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788941201.610191:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941201.610212:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151baa expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.610274:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 43 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.610289:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 43 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.610307:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:3.0:1788941201.610311:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788941201.610315:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc0031a00, rc 0) 00000100:00100000:3.0:1788941201.610680:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+43:18866:x1875840075998080:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 525us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.610689:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:2.0:1788941201.625457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.625770:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075998208 00000100:00100000:1.0:1788941201.625780:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075998208 00000100:00100000:1.0:1788941201.625878:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:1.0:1788941201.625890:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2406:x1875840075998208:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788941201.626313:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2406:x1875840075998208:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 424us (866us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788941201.626401:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00080000:2.0:1788941201.628639:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788941201.641968:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941201.642097:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075998464 00000100:00100000:0.0:1788941201.642108:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075998464 00000100:00100000:0.0:1788941201.642464:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:0.0:1788941201.642486:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+43:18866:x1875840075998464:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788941201.642716:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+44:18866:x1875840075998464:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 233us (757us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788941201.642724:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:0.0:1788941201.645531:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.646324:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075998720 00000100:00100000:2.0:1788941201.646346:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075998720 00000100:00100000:2.0:1788941201.646406:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:2.0:1788941201.646418:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+44:18866:x1875840075998720:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788941201.646558:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+44:18866:x1875840075998720:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 143us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941201.646567:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:2.0:1788941201.663831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.664251:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075998848 00000100:00100000:1.0:1788941201.664263:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075998848 00000100:00100000:1.0:1788941201.664373:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:1.0:1788941201.664385:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+44:18866:x1875840075998848:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788941201.664407:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941201.664428:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f432 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151bb1 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.664507:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f439 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.664522:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f439 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.664534:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f439 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941201.664586:0:22696:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788941201.664607:0:22696:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f439 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.664634:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f432 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb1 expref: 46 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.664651:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f439 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb1 expref: 45 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.664680:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:1.0:1788941201.664683:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788941201.664687:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80d800, rc 0) 00000100:00100000:1.0:1788941201.664744:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+45:18866:x1875840075998848:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 362us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941201.664751:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:2.0:1788941201.671318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.676030:0:25391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075998976 00000100:00100000:3.0:1788941201.676047:0:25391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075998976 00000100:00100000:2.0:1788941201.676440:0:25391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788941201.676451:0:25391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2404:x1875840075998976:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788941201.676478:0:25391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941201.676500:0:25391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151bb8 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788941201.676525:0:25391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa11390, blocks: 0x0 00010000:00010000:2.0:1788941201.676543:0:25391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=810s v=(0 0) 00010000:00010000:2.0:1788941201.676548:0:25391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941201.676557:0:25391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 7 pid: 25391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.676582:0:25391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 7 pid: 25391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.676611:0:25391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbfeb1f400, rc 0) 00000100:00100000:2.0:1788941201.676670:0:25391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:2404:x1875840075998976:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 222us (5363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941201.676677:0:25391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788941201.687916:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.688046:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075999232 00000100:00100000:3.0:1788941201.688057:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075999232 00000100:00100000:3.0:1788941201.688125:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:3.0:1788941201.688163:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+45:18866:x1875840075999232:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788941201.688285:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+45:18866:x1875840075999232:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 151us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.688292:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:2.0:1788941201.693082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.693300:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075999360 00000100:00100000:3.0:1788941201.693311:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075999360 00000100:00100000:3.0:1788941201.693383:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:3.0:1788941201.693394:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+45:18866:x1875840075999360:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788941201.705503:0:22676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1788941201.705519:0:22676:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788941201.705585:0:22676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1788941201.705751:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.705765:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.705772:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.705778:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09ac00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941201.705782:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.705789:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.705805:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:1.0:1788941201.705808:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788941201.705813:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.705819:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09ac00/0x24b6539075b3f256 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706000:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706009:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706015:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706021:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09b600 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941201.706024:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706030:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706040:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cac6a5df00) 00010000:00010000:3.0:1788941201.706042:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941201.706045:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706051:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09b600/0x24b6539075b3f202 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706087:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706094:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706100:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706105:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbfc09a200 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941201.706108:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706114:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706121:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:3.0:1788941201.706124:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941201.706126:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706143:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbfc09a200/0x24b6539075b3f209 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706163:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706169:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706174:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706186:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc0030400 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941201.706189:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706195:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706205:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99cac6855400) 00010000:00010000:3.0:1788941201.706207:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941201.706210:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706215:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f2b1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706234:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706241:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706247:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706251:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db0200 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941201.706254:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706259:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706278:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941201.706280:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941201.706283:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706288:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0200/0x24b6539075b3f336 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706299:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706305:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706309:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706314:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db0c00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941201.706316:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706321:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706327:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941201.706339:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941201.706342:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706347:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db0c00/0x24b6539075b3f359 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706369:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706376:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706381:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706387:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7ec4c00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941201.706390:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706397:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706405:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941201.706408:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941201.706411:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706416:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4c00/0x24b6539075b3f39f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706426:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706430:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706435:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706446:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db1200 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941201.706449:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706454:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706461:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:3.0:1788941201.706463:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788941201.706466:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.706471:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1200/0x24b6539075b3f424 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941201.706622:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+14:18866:x1875840075999360:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 13226us (13557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.706633:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:1.0:1788941201.707304:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102322816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788941201.707374:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941201.707713:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102322816 00000100:00100000:0.0:1788941201.707729:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102322816 00000100:00100000:0.0:1788941201.707783:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788941201.707791:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102322816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788941201.707934:0:24204:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788941201.707938:0:24204:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788941201.707941:0:24204:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788941201.707943:0:24204:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788941200 -> 1788941200 00002000:00010000:0.0:1788941201.707946:0:24204:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788941201.707984:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1875840102322816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (610us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788941201.707991:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1788941201.708031:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cbe572c700/2, rc 0, transno 12884901892 00000100:00100000:0.0:1788941201.708037:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102322816:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788941201.708310:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788941201.714708:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.715387:0:25391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075999488 00000100:00100000:3.0:1788941201.715399:0:25391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075999488 00000100:00100000:3.0:1788941201.715454:0:25391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:3.0:1788941201.715583:0:25391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:2403:x1875840075999488:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788941201.715700:0:25391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:2403:x1875840075999488:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 236us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.715709:0:25391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:0.0:1788941201.719826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.720560:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075999744 00000100:00100000:3.0:1788941201.720582:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075999744 00000100:00100000:3.0:1788941201.720647:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:3.0:1788941201.720675:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+14:18866:x1875840075999744:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788941201.720744:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941201.720770:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80d800/0x24b6539075b3f439 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb1 expref: 14 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.720790:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:3.0:1788941201.720795:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788941201.720827:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f447 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.721067:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f447 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.721088:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f447 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788941201.722019:0:22698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a02b596a reply state 000000002bd27422 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f447 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.722036:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030400/0x24b6539075b3f447 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.722044:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:3.0:1788941201.722046:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788941201.722050:0:22698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788941201.722197:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+15:18866:x1875840075999744:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1523us (2385us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1788941201.722206:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:2.0:1788941201.745782:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941201.745932:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840075999872 00000100:00100000:0.0:1788941201.745943:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840075999872 00000100:00100000:0.0:1788941201.746003:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:0.0:1788941201.746013:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18866:x1875840075999872:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788941201.746031:0:24204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941201.746049:0:24204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151bbf expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.746097:0:24204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 8 pid: 25391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.746107:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941201.746123:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941201.746139:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 8 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.746176:0:24204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 8 pid: 25391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.746190:0:24204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 8 pid: 25391 timeout: 910 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941201.746205:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24204:1875840102322944:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788941201.746296:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb70b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788941201.748978:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24204:1875840102322944:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788941201.749010:0:24204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 8 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.749028:0:24204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cac7db0a00, rc 0) 00000100:00100000:0.0:1788941201.749095:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+8:18866:x1875840075999872:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3083us (3323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941201.749103:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:2.0:1788941201.752196:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.752342:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076000000 00000100:00100000:3.0:1788941201.752352:0:22681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076000000 00010000:00010000:3.0:1788941201.752409:0:22681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 8 pid: 25391 timeout: 910 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941201.752454:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:3.0:1788941201.752465:0:22681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+8:2403:x1875840076000000:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788941201.752493:0:22681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941201.752519:0:22681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 8 pid: 25391 timeout: 910 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.752534:0:22681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 8 pid: 25391 timeout: 910 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.752558:0:22681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088562a20/0x24b6539075b3f440 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bb8 expref: 8 pid: 25391 timeout: 910 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.752586:0:22681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941201.752590:0:22681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941201.752597:0:22681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 7 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.752607:0:22681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 7 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.752647:0:22681:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 7 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941201.752674:0:22681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb7a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22681:1875840102323072:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788941201.752754:0:22681:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb785cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941201.755920:0:22681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb7a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22681:1875840102323072:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788941201.755946:0:22681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941201.756002:0:22681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:2403:x1875840076000000:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3538us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.756013:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788941201.758322:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.758998:0:25391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076000128 00000100:00100000:3.0:1788941201.759008:0:25391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076000128 00000100:00100000:3.0:1788941201.759075:0:25391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:3.0:1788941201.759085:0:25391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:2403:x1875840076000128:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788941201.759385:0:25391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788941201.759389:0:25391:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788941200 00002000:00010000:3.0:1788941201.759392:0:25391:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788941197 00002000:00010000:3.0:1788941201.759394:0:25391:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788941200 -> 1788941200 00002000:00010000:3.0:1788941201.759397:0:25391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788941201.759462:0:25391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+8:2403:x1875840076000128:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 377us (1146us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788941201.759623:0:25391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:2.0:1788941201.776094:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941201.776327:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076000256 00000100:00100000:0.0:1788941201.776348:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076000256 00000100:00100000:0.0:1788941201.776413:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788941201.776425:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+8:2404:x1875840076000256:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788941201.776491:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.776531:0:24204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 8 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.776540:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941201.776544:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788941201.776549:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.776594:0:24204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 8 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.776609:0:24204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 8 pid: 24204 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941201.776626:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24204:1875840102323200:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788941201.776761:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cacb70b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788941201.793232:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.793327:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076000384 00000100:00100000:1.0:1788941201.793348:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076000384 00010000:00010000:1.0:1788941201.793392:0:22682:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 9 pid: 24204 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.793437:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:1.0:1788941201.793447:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:2404:x1875840076000384:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941201.793463:0:22682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941201.793496:0:22682:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 9 pid: 24204 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.793512:0:22682:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 9 pid: 24204 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.793538:0:22682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788941201.793543:0:22682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788941201.793549:0:22682:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.793560:0:22682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.793693:0:22682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941201.793778:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+9:2404:x1875840076000384:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 332us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941201.793786:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00010000:00010000:0.0:1788941201.794273:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d799a8c/0x24b6539075b3f44e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bbf expref: 8 pid: 24204 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941201.794292:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24204:1875840102323200:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788941201.794316:0:24204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794339:0:24204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794354:0:24204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794377:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794386:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794393:0:24204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794400:0:24204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db1e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:0.0:1788941201.794404:0:24204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794413:0:24204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794425:0:24204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.794432:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e82323d5/0x24b6539075b3f455 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941201.794509:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:2404:x1875840076000256:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 18087us (18425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941201.794517:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:2.0:1788941201.818877:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.819038:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076000640 00000100:00100000:1.0:1788941201.819049:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076000640 00000100:00100000:1.0:1788941201.819121:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788941201.819132:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+15:18866:x1875840076000640:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788941201.819233:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.819254:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 15 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.819264:0:22696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.819302:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 15 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.819315:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 15 pid: 22696 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.819339:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102323328:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788941201.819423:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbca8a6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788941201.825975:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.826577:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076000768 00000100:00100000:3.0:1788941201.826590:0:22683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076000768 00010000:00010000:3.0:1788941201.826639:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 16 pid: 22696 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941201.826749:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:3.0:1788941201.826760:0:22683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+16:2403:x1875840076000768:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788941201.826778:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941201.826785:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 16 pid: 22696 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.826798:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 16 pid: 22696 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.826824:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941201.826830:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b8e expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.826877:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.826886:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.826893:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.826926:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941201.826979:0:22683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+16:2403:x1875840076000768:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 221us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.826986:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00010000:00010000:1.0:1788941201.827642:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f32f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b5d expref: 15 pid: 22696 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.827671:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102323328:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788941201.827698:0:22696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.827707:0:22696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.827714:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.828025:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.828039:0:22696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 15 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.828048:0:22696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.828080:0:22696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 15 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.828096:0:22696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 15 pid: 25742 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.828111:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102323456:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788941201.828967:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc90a8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788941201.842707:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.842911:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102323456:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788941201.842941:0:22696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941201.843309:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076000896 00000100:00100000:3.0:1788941201.843340:0:22682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076000896 00010000:00010000:3.0:1788941201.843382:0:22682:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 16 pid: 25742 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941201.843427:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:3.0:1788941201.843437:0:22682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac7f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+16:2404:x1875840076000896:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788941201.843453:0:22682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941201.843460:0:22682:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 16 pid: 25742 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.843483:0:22682:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 16 pid: 25742 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.843506:0:22682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f42b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x69d7c94080151baa expref: 16 pid: 25742 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.843521:0:22682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:3.0:1788941201.843526:0:22682:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.843536:0:22682:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.843544:0:22682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.843579:0:22682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941201.843643:0:22682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac7f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+15:2404:x1875840076000896:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 208us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.843661:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00010000:00010000:1.0:1788941201.843864:0:22696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.843872:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788941201.843985:0:22696:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:1.0:1788941201.844120:0:22696:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1788941201.844151:0:22696:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:1.0:1788941201.844224:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22696:1875840102323584:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788941201.844272:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941201.844305:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbc4977b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788941201.844575:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102323584 00000100:00100000:3.0:1788941201.844582:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102323584 00000100:00100000:3.0:1788941201.844623:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788941201.844631:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22696:x1875840102323584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788941201.844704:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22696:x1875840102323584:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.844712:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788941201.846004:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22696:1875840102323584:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788941201.846202:0:22696:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1788941201.846279:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22696:1875840102323712:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788941201.846342:0:22696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941201.846362:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbca8a6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941201.846587:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102323712 00000100:00100000:0.0:1788941201.846594:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102323712 00000100:00100000:0.0:1788941201.846639:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788941201.846649:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22696:x1875840102323712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788941201.846783:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22696:x1875840102323712:12345-0@lo:1000:mdt00_000.0 Request processed in 135us (454us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788941201.846790:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788941201.847045:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22696:1875840102323712:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788941201.847100:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847110:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847118:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847141:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80cc00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941201.847146:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847154:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847169:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:1.0:1788941201.847171:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788941201.847177:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847184:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80cc00/0x24b6539075b3f463 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847215:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847221:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847226:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847231:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc0030800 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941201.847233:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847239:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847257:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941201.847259:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788941201.847267:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b8e expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847279:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b8e expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847288:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b8e expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.847558:0:22696:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7ec4400/0x24b6539075b3f3c2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151b8e expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.847580:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102323840:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788941201.847654:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cbca8a6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941201.851886:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22696:1875840102323840:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788941201.851936:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.851947:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030800/0x24b6539075b3f3bb lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.851984:0:22696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.851999:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852030:0:22696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852040:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852047:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852053:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852059:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80da00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941201.852209:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852218:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852230:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941201.852233:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941201.852236:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852243:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80da00/0x24b6539075b3f46a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852253:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852260:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852272:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852277:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cacb80c200 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:1.0:1788941201.852280:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852287:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852295:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:1.0:1788941201.852298:0:22696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788941201.852301:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.852306:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cacb80c200/0x24b6539075b3f45c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22696 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941201.852613:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+18:18866:x1875840076000640:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 33480us (33786us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1788941201.852624:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000020:00080000:1.0:1788941201.852631:0:22696:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788941201.853616:0:22731:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788941201.853623:0:22731:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788941201.853638:0:22731:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788941201.853645:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788941201.864772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941201.864872:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076001024 00000100:00100000:0.0:1788941201.864884:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076001024 00000100:00100000:0.0:1788941201.864952:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:0.0:1788941201.864962:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+18:18865:x1875840076001024:12345-192.168.201.42@tcp:49:bash.0 00000100:00100000:0.0:1788941201.865121:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+18:18865:x1875840076001024:12345-192.168.201.42@tcp:49:bash.0 Request processed in 159us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941201.865129:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788941201.868693:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.869806:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941201.869935:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076001408 00000100:00100000:1.0:1788941201.869945:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076001408 00000100:00100000:1.0:1788941201.869993:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788941201.870003:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+7:18865:x1875840076001408:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788941201.870021:0:24205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941201.870040:0:24205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f471 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151bc6 expref: -99 pid: 24205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788941201.870095:0:24205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa11390, atime: 0x6aa1138d, ctime: 0x6aa11390, blocks: 0x0 00010000:00010000:1.0:1788941201.870119:0:24205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=810s v=(0 0) 00010000:00010000:1.0:1788941201.870124:0:24205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941201.870134:0:24205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f471 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bc6 expref: 8 pid: 24205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.870151:0:24205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000225f3866/0x24b6539075b3f471 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bc6 expref: 8 pid: 24205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941201.870164:0:24205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cacb80c200, rc 0) 00000100:00100000:1.0:1788941201.870223:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+8:18865:x1875840076001408:12345-192.168.201.42@tcp:101:bash.0 Request processed in 221us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941201.870231:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788941201.871587:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076001280 00000100:00100000:0.0:1788941201.871599:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076001280 00000100:00100000:0.0:1788941201.871650:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:0.0:1788941201.871659:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbfeb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+18:18866:x1875840076001280:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788941201.871967:0:22699:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788941201.872043:0:22699:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1788941201.873044:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.873091:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.873104:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.873115:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.873122:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.873129:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941201.873162:0:22699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788941201.873284:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbfeb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+20:18866:x1875840076001280:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 1623us (4597us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1788941201.873295:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000020:00080000:0.0:1788941201.873301:0:22699:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788941201.874091:0:22684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941201.874100:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.874108:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cac7db1e00 already unused, calling callback (ffffffffc0c8e8b0) 00010000:00010000:2.0:1788941201.874112:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.874132:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.874157:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cac6855e00) 00010000:00010000:2.0:1788941201.874160:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788941201.874166:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.874171:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cac7db1e00/0x24b6539075b3f478 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941201.874187:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941201.874189:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941201.874190:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941201.878198:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.878269:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076001536 00000100:00100000:3.0:1788941201.878280:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076001536 00000100:00100000:3.0:1788941201.878342:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:3.0:1788941201.878353:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+20:18865:x1875840076001536:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788941201.878375:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941201.878395:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f47f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151bcd expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.878436:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031200/0x24b6539075b3f486 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.878452:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031200/0x24b6539075b3f486 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.878478:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031200/0x24b6539075b3f486 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.878631:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f47f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bcd expref: 22 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.878650:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031200/0x24b6539075b3f486 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bcd expref: 21 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.878658:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941201.878662:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788941201.878666:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc0031200, rc 0) 00000100:00100000:3.0:1788941201.878732:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+21:18865:x1875840076001536:12345-192.168.201.42@tcp:101:bash.0 Request processed in 381us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941201.878741:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:1.0:1788941201.882033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941201.882261:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076001792 00000100:00100000:2.0:1788941201.882272:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076001792 00000100:00100000:2.0:1788941201.882323:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788941201.882345:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+21:18865:x1875840076001792:12345-192.168.201.42@tcp:35:bash.0 00000001:00080000:2.0:1788941201.882583:0:22700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1788941201.882667:0:22700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1788941201.882787:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+24:18865:x1875840076001792:12345-192.168.201.42@tcp:35:bash.0 Request processed in 443us (764us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1788941201.882794:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000020:00080000:2.0:1788941201.882799:0:22700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788941201.996664:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941201.997001:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076002048 00000100:00100000:3.0:1788941201.997011:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076002048 00000100:00100000:3.0:1788941201.997073:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:3.0:1788941201.997081:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+24:18876:x1875840076002048:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788941201.997103:0:25742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941201.997132:0:25742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f48d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x69d7c94080151bd4 expref: -99 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941201.997247:0:25742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788941201.997359:0:25742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f48d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bd4 expref: 26 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.997688:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cac6855800) 00010000:00010000:3.0:1788941201.997692:0:25742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788941201.997718:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f48d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x69d7c94080151bd4 expref: 26 pid: 25742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941201.997734:0:25742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc0031a00, rc 0) 00000100:00100000:3.0:1788941201.997811:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+25:18876:x1875840076002048:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 730us (1157us total) trans 12884901930 rc 301/301 00000100:00100000:3.0:1788941201.997819:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:1.0:1788941202.002663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788941202.002917:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076002176 00000100:00100000:3.0:1788941202.002929:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076002176 00000100:00100000:3.0:1788941202.002993:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:3.0:1788941202.003005:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+25:18876:x1875840076002176:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:3.0:1788941202.003090:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003110:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003130:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003162:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003170:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003177:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003276:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003304:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003312:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788941202.003360:0:22698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003385:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003392:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003399:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003406:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc0031a00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941202.003411:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003419:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003434:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cac6a5db00) 00010000:00010000:3.0:1788941202.003437:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941202.003443:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003449:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031a00/0x24b6539075b3f49b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003483:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003489:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003495:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003500:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc0031000 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941202.003504:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003510:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003519:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99cac6855400) 00010000:00010000:3.0:1788941202.003521:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941202.003524:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003530:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0031000/0x24b6539075b3f4a2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003549:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003556:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003569:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003581:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc0030c00 already unused, calling callback (ffffffffc18b44f0) 00010000:00010000:3.0:1788941202.003585:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003591:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003599:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cac6855900) 00010000:00010000:3.0:1788941202.003601:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941202.003605:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941202.003610:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc0030c00/0x24b6539075b3f4a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941202.003697:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+25:18876:x1875840076002176:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 694us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941202.003705:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:2.0:1788941202.009646:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788941202.009750:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076002432 00000100:00100000:1.0:1788941202.009761:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076002432 00000100:00100000:1.0:1788941202.009830:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788941202.009877:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+25:18876:x1875840076002432:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788941202.010711:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+26:18876:x1875840076002432:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 834us (1075us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1788941202.010719:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00010000:00010000:2.0:1788941202.247659:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941203.268778:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788941204.050591:0:25780:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788941204.294124:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941204.356205:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788941204.356242:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cac66dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102323968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788941204.356315:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941204.356358:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102323968 00000100:00100000:1.0:1788941204.356365:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102323968 00000100:00100000:1.0:1788941204.356410:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788941204.356417:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102323968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788941204.356443:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788941204.356604:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875840102323968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 186us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941204.356612:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788941204.356634:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788941204.356665:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cac66dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875840102323968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788941204.358348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb7a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102324096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788941204.358408:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941204.358485:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102324224:0@lo:400:kworker.0 00000100:00100000:0.0:1788941204.358511:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102324480:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.358551:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941204.358597:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102324096 00000100:00100000:1.0:1788941204.358604:0:24207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102324096 00000100:00100000:1.0:1788941204.358647:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788941204.358655:0:24207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875840102324096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788941204.358675:0:24207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788941204.358703:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102324352:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.358728:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102324736:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.358775:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941204.358799:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102324864:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.358856:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941204.358876:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875840102325376:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.358882:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102324224 00000100:00100000:3.0:1788941204.358887:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102324224 00000100:00100000:2.0:1788941204.358900:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941204.358929:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788941204.358929:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102324352 00000100:00100000:2.0:1788941204.358933:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102324352 00000100:00100000:3.0:1788941204.358937:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3651:x1875840102324224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.358959:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788941204.358965:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102324352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.358968:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97+24:3651:x1875840102324224:12345-0@lo:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941204.358985:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788941204.358999:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875840102324352:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.359005:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788941204.359022:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102325376 00000100:00100000:2.0:1788941204.359026:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102325376 00000100:00100000:3.0:1788941204.359033:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941204.359052:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102325248:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.359074:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941204.359081:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102325248 00000100:00100000:2.0:1788941204.359084:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102325248 00000100:00100000:3.0:1788941204.359102:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:105d8f83-5ac4-4ff2-bc3d-61a34eb91c97:3651:1875840102324224:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.359103:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788941204.359109:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875840102325376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.359127:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102324736 00000100:00100000:3.0:1788941204.359131:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102324736 00000100:00100000:2.0:1788941204.359139:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875840102325376:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.359145:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788941204.359150:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788941204.359155:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788941204.359156:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102324736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.359160:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102325248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.359187:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875840102325248:12345-0@lo:400:kworker.0 Request processed in 26us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941204.359189:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102324736:12345-0@lo:400:kworker.0 Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941204.359195:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788941204.359197:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788941204.359215:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102324608:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.359230:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875840102324352:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.359237:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941204.359240:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875840102325376:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.359251:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875840102325120:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.359270:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102324608 00000100:00100000:2.0:1788941204.359274:0:25742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102324608 00000100:00100000:2.0:1788941204.359295:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788941204.359301:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102324608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.359330:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875840102324608:12345-0@lo:400:kworker.0 Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.359336:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788941204.359361:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102324736:0@lo:400:kworker.0 00010000:00080000:2.0:1788941204.359373:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cacb92ce00 x1875840102325248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941204.359383:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875840102325248:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.359394:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941204.359416:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102325120 00000100:00100000:2.0:1788941204.359420:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102325120 00000100:00100000:3.0:1788941204.359426:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875840102324608:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.359435:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788941204.359441:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102324992:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.359441:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788941204.359447:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875840102325120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.359464:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941204.359473:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875840102325120:12345-0@lo:400:kworker.0 Request processed in 26us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941204.359479:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875840102325504:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.359479:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788941204.359489:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102324992 00000100:00100000:2.0:1788941204.359491:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102324992 00000100:00100000:3.0:1788941204.359498:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941204.359578:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875840102325120:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.360103:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102325504 00000100:00100000:3.0:1788941204.360126:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788941204.360134:0:25742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102324992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.360178:0:25742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875840102324992:12345-0@lo:400:kworker.0 Request processed in 46us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941204.360184:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788941204.360211:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875840102324992:0@lo:400:kworker.0 00000100:00080000:3.0:1788941204.360254:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788941204.360259:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941204.360262:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788941204.360291:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102324864 00000100:00100000:3.0:1788941204.360296:0:24203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102324864 00000100:00100000:3.0:1788941204.360330:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788941204.360337:0:24203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102324864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.360374:0:24203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102324864:12345-0@lo:400:kworker.0 Request processed in 38us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941204.360380:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788941204.360394:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788941204.360417:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102324864:0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.360429:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102325504 00000100:00080000:3.0:1788941204.360446:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788941204.360459:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788941204.360465:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875840102325504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.360622:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875840102325504:12345-0@lo:400:kworker.0 Request processed in 157us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.360629:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788941204.360999:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941204.361004:0:24207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875840102324096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2349us (2596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941204.361012:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788941204.361637:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102324480 00000100:00100000:2.0:1788941204.361646:0:24205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102324480 00010000:00080000:3.0:1788941204.361746:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cacb92d500 x1875840102325504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941204.361760:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875840102325504:0@lo:400:kworker.0 00000100:00100000:3.0:1788941204.362025:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb7a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875840102324096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788941204.364926:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788941204.364946:0:24205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102324480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941204.365060:0:24205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102324480:12345-0@lo:400:kworker.0 Request processed in 122us (4061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.365067:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788941204.366091:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102324480:0@lo:400:kworker.0 00000100:00080000:3.0:1788941204.366185:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941204.431962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432054:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432079:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432139:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432172:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432197:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.432228:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076003072 00000100:00100000:2.0:1788941204.432239:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076003072 00000100:00100000:2.0:1788941204.432293:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076003584 00000100:00100000:2.0:1788941204.432296:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076003584 00000100:00100000:2.0:1788941204.432310:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076002944 00000100:00100000:2.0:1788941204.432313:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076002944 00000100:00100000:2.0:1788941204.432326:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076003456 00000100:00100000:2.0:1788941204.432343:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076003456 00000100:00100000:2.0:1788941204.432363:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788941204.432373:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+8:2405:x1875840076003072:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941204.432465:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+8:2405:x1875840076003072:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 92us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.432472:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788941204.432490:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788941204.432496:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2405:x1875840076003584:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941204.432532:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2405:x1875840076003584:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.432538:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788941204.432550:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788941204.432556:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2405:x1875840076002944:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941204.432579:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2405:x1875840076002944:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.432585:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788941204.432597:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788941204.432602:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2405:x1875840076003456:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941204.432622:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2405:x1875840076003456:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.432627:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788941204.432754:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076002816 00000100:00100000:2.0:1788941204.432758:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076002816 00000100:00100000:2.0:1788941204.432779:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076003328 00000100:00100000:2.0:1788941204.432787:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076003328 00000100:00100000:2.0:1788941204.432800:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076002688 00000100:00100000:2.0:1788941204.432802:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076002688 00000100:00100000:2.0:1788941204.432813:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076003200 00000100:00100000:2.0:1788941204.432815:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076003200 00000100:00100000:2.0:1788941204.432826:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:2.0:1788941204.432869:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2405:x1875840076002816:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941204.432902:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+5:2405:x1875840076002816:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 71us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.432908:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:2.0:1788941204.432920:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:2.0:1788941204.432925:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2405:x1875840076003328:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941204.432946:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+5:2405:x1875840076003328:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.432952:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:2.0:1788941204.432963:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:2.0:1788941204.432969:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+26:2405:x1875840076002688:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941204.432994:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+26:2405:x1875840076002688:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.432999:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:2.0:1788941204.433010:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:2.0:1788941204.433016:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2405:x1875840076003200:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788941204.433037:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c8bf894-fc68-4f81-b82b-b4b6edc81d8c+6:2405:x1875840076003200:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941204.433042:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00080000:2.0:1788941204.433099:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941204.433103:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941204.433106:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788941204.433108:0:22692:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788941204.433602:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076002560 00000100:00100000:3.0:1788941204.433616:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076002560 00000100:00100000:3.0:1788941204.433684:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 171 00000100:00100000:3.0:1788941204.433692:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+13:2405:x1875840076002560:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788941204.433728:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a79c71a8-4021-46b6-985c-4d69e840c681+13:2405:x1875840076002560:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941204.433734:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 171 00000100:00100000:1.0:1788941204.871040:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941204.871066:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102325632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788941204.871145:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941204.872286:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102325632 00000100:00100000:0.0:1788941204.872297:0:24206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102325632 00000100:00100000:0.0:1788941204.872369:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788941204.872379:0:24206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cac66da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102325632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788941204.872413:0:24206:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941204.872484:0:24206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cac66da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102325632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941204.872503:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788941204.872750:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102325632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788941204.934576:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788941204.934626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788941204.936656:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076003712 00000100:00100000:0.0:1788941204.936672:0:24208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076003712 00002000:00100000:0.0:1788941204.936727:0:24208:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff99cacb92c700 x1875840076003712/t0(0) o4->31675bd2-e013-440d-8bcf-f5ceaf85e2d2@192.168.201.42@tcp:425/0 lens 504/0 e 0 to 0 dl 1788941215 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788941204.936738:0:24208:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99cacb92c700 with x1875840076003712 ext(0->8) 00002000:00010000:0.0:1788941204.936745:0:24208:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cacb92c700 00000100:00100000:0.0:1788941204.936787:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788941204.936798:0:24208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+8:2403:x1875840076003712:12345-192.168.201.42@tcp:4:bash.0 00000100:00100000:3.0:1788941204.939395:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840076003840 00000100:00100000:3.0:1788941204.939408:0:24204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840076003840 00000100:00100000:3.0:1788941204.939464:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788941204.939474:0:24204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+11:2403:x1875840076003840:12345-192.168.201.42@tcp:16:kworker.0 00000100:00100000:3.0:1788941204.940321:0:24208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+11:2403:x1875840076003712:12345-192.168.201.42@tcp:4:bash.0 Request processed in 3521us (5689us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788941204.940337:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:3.0:1788941204.940348:0:24208:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff99cacb92c700 x1875840076003712/t12884901895(0) o4->31675bd2-e013-440d-8bcf-f5ceaf85e2d2@192.168.201.42@tcp:425/0 lens 504/448 e 0 to 0 dl 1788941215 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788941204.940360:0:24208:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99cacb92c700 with x1875840076003712 ext(0->8) 00002000:00010000:3.0:1788941204.940367:0:24208:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cacb92c700 00000001:00080000:0.0:1788941204.944914:0:25018:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1788941204.944939:0:25018:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000100:00100000:3.0:1788941204.946741:0:24204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31675bd2-e013-440d-8bcf-f5ceaf85e2d2+6:2403:x1875840076003840:12345-192.168.201.42@tcp:16:kworker.0 Request processed in 7256us (12163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941204.946755:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00010000:00010000:2.0:1788941205.318476:0:22684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941205.892224:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788941205.892249:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cacb7a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102325760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788941205.892325:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941205.892474:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102325760 00000100:00100000:0.0:1788941205.892483:0:24206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102325760 00000100:00100000:0.0:1788941205.892557:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788941205.892568:0:24206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb7a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102325760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788941205.892593:0:24206:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941205.892647:0:24206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb7a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875840102325760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941205.892655:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788941205.892695:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cacb7a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875840102325760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941205.892915:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788941205.892926:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102325888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941205.892969:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941205.893104:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102325888 00000100:00100000:3.0:1788941205.893110:0:23439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102325888 00000100:00100000:3.0:1788941205.893163:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788941205.893171:0:23439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbe572ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102325888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788941205.893199:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788941205.893247:0:23439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbe572ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875840102325888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941205.893255:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788941205.893317:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cc01b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875840102325888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941205.914202:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cbe572ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102326016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941205.914281:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941205.916013:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840102326016 00000100:00100000:0.0:1788941205.916025:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840102326016 00000100:00100000:0.0:1788941205.916105:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788941205.916117:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cacb92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102326016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788941205.916160:0:22701:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941205.916235:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cacb92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875840102326016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941205.916242:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788941205.916619:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cbe572ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875840102326016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788941206.356412:0:22685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14703 lines, 14703 kept, 0 dropped, 0 bad.